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Abstract 


The  goal  of  this  research  effort  was  to  develop  educational  cases  that  would  bridge 
the  gap  between  the  theory  and  principles  of  cost  estimating  currently  taught  in  the  Air 
Force  Institute  of  Technology  (AFIT)  Graduate  Cost  Analysis  (GCA)  curriculum  and  the 
real  world  of  cost  estimating  in  the  acquisition  arena. 

To  achieve  these  goals,  the  following  research  objectives  were  investigated;  (1) 
Identify  cost  estimating  skills  that  graduates  of  the  AFIT  GCA  curriculum  are  expected  to 
possess.  (2)  Assess  the  relative  importance  of  the  identified  cost  estimating  skills.  (3) 
Select  weapon  system  scenarios  that  are  relevant,  interesting,  and  facilitate  student 
performance  ofidentified  cost  estimating  skills.  (4)  Provide  cases  based  on  realistic 
scenarios  that  will  facilitate  student  learning  of  important  cost  estimating  skills. 

The  cases  developed  in  this  research  effort  were  implemented  in  the  summer 
quarter  1993  GCA  seminar  class.  Feedback  fi’om  seminar  students  and  Air  Force  cost 
estimating  organizations  was  collected  to  measure  the  overall  effectiveness  of  these  cases 
in  facilitating  student  learning.  The  results  show  that  the  cases  developed  in  this  effort  are 
effective  in  developing  the  AFIT  GCA  students'  abilities  to  apply  cost  estimating 
techniques. 


COST  ESTIMATING  CASES: 


EDUCATIONAL  TOOLS  FOR  COST  ANALYSTS 


I.  Introduction 


General  Issue 

For  the  last  50  years  the  Department  of  Defense  (DoD)  has  relied  on  a  mixture  of 
evolutionary  and  revolutionary  technological  advantages  to  offset  the  c^abilities  of 
numerically  superior  adversaries  (1:4).  Fielding  technologically  superior  systems  has  been 
our  competitive  advantage  in  the  business  of  war  (1:4).  Throughout  this  period,  the  DoD 
acquisition  process  has  provided  the  vehicle  for  bringing  these  concepts  of  technological 
superiority  to  fruition  on  the  battlefield.  Due  to  the  large  dollar  values  associated  with  the 
development  of  any  major  weapon  system,  the  acquisition  process  has  historically  been 
heavily  scrutinized  by  Congress  and  the  general  pubhc.  In  recent  years,  however,  this 
attention  has  escalated  significantly  as  our  nation  attempts  to  come  to  grips  with  a  defense 
budget  that  is  projected  to  continue  shrinking  into  the  year  2000  (2:36).  Correspondingly, 
.the  cost  estimates  that  support  major  weapon  system  program  decisions  have  become 
increasingly  important. 

Cost  estimating  is  an  essential  aspect  of  the  acquisition  process  and  is  used 
throughout  every  phase  in  the  life  of  a  weapon  system.  The  National  Estimating  Society 
has  defined  cost  estimating  as  "the  art  of  approximating  the  probable  work  or  cost  of 
something  based  on  information  available  at  the  time"  (3;  14).  A  partial  list  of  terms 
related  to  the  cost  estimating  field  is  provided  in  Appendix  A.  The  responsibilities  of  DoD 
acquisition  cost  analysts  have  become  increasingly  significant  and  correspondingly 
complex  as  the  acquisition  environment  continues  to  evolve  in  this  era  of  austere  funding. 
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Each  cost  estimating  effort  is  unique  in  that  the  specific  tools  and  techniques  employed 
vary  significantly  depending  on: 

1.  The  type  of  weiq)on  system. 

2.  The  phase  of  the  acquisition  process  the  weapon  system  currently  inhabits. 

(i.e.,  concept  exploration,  demonstration/validation,  engineering  and 
manufacturing  development,  production,  or  operations  and  support). 

3.  The  amount  of  data  available. 

4.  The  amount  of  time  provided  to  conduct  the  analysis. 

5.  The  phase  of  the  weapon  system  life  cycle  being  estimated. 

The  selection  of  the  proper  tools  required  to  meet  the  demands  of  the  above  factors 
requires  substantial  judgment,  complemented  by  corresponding  experience,  on  the  part  of 
the  cost  analyst  preparing  the  estimate. 

This  complexity  has  resulted  in  a  need  for  instructional  methods  that  can  equip 
DoD  cost  analysts  with  a  wide  range  of  analytical  tools  to  meet  the  demands  of  this 
dynamic  environment.  At  this  point  the  terms  cost  estimating  techniques  and  cost 
estimating  skills  need  to  be  addressed.  A  technique  is  defined  as  "a  technical  method  of 
accomplishing  a  specific  aim"  (4:1335),  while  a  skill  refers  to  "the  ability,  coming  from 
one's  knowledge,  practice,  aptitude,  etc.,  to  do  something  well"  (5:2348).  For  example, 
parametric  cost  estimating  is  a  technique,  while  the  ability  to  build  automated  spreadsheets 
is  a  skill.  The  acquisition  cost  analyst  must  have  adequate  knowledge  of  the  various 
estimating  techniques,  but  it  is  his  skill  in  applying  those  techniques  that  will  make  him 
successful.  Thus  the  focus  of  this  research  effort  is  on  developing  students'  cost 
estimating  skills  through  the  proper  application  of  cost  estimating  techniques. 

Many  of  the  cost  estimating  techniques  used  in  DoD  acquisition  are  currently  being 
addressed  in  the  Air  Force  Institute  of  Technology  (AFTT)  Graduate  Cost  Analysis  (GCA) 
curriculum.  The  GCA  curriculum  consists  of  64  hours  of  graduate  level  instruction. 
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Twenty-seven  of  those  64  hours  are  directly  aimed  at  teaching  cost  analysis  techniques 
and  developing  the  students'  estimating  skills  (6).  A  brief  description  of  the  courses  that 
make-up  the  27  hours  of  cost  analysis  instruction  is  provided  in  Appendix  B  (7). 

The  AFTT  GCA  program  is  sponsored  by  the  Deputy  Assistant  Secretary  of  the 
Air  Force,  Cost  and  Economics  (SAF/FMC).  During  the  1992  curriculum  review  with 
SAF/FMC,  it  was  determined  that  AFTT  students  should  receive  more  opportunities  to 
■practice  the  application  of  the  cost  estimating  techniques  taught  in  the  curriculum.  This 
need  was  also  substantiated  by  recent  GCA  graduates,  who  provided  feedback  to  the  GCA 
program  manager  at  AFTT  (6).  This  curriculum  review  led  to  the  decision  to  redesign  one 
of  the  existing  AFTT  courses  to  emphasize  the  application  of  cost  estimating  techniques 
within  the  acquisition  framework.  It  was  clear  that  a  traditional  lecture-type  course  would 
not  provide  the  level  of  learning  dictated  by  application  learning  objectives.  The  GCA 
program  manager  decided  to  pursue  the  case  method  of  instruction  to  meet  this  need. 

This  led  to  the  decision  that  cost  estimating  cases  should  be  presented  in  a  seminar  class 
format  to  provide  students  with  a  realistic  background  to  practice  the  application  of  cost 
estimating  skills.  Under  the  sponsorship  of  SAF/FMC,  this  thesis  effort  was  initiated  to 
develop  such  cases. 

Specific  Research  Problem 

Many  GCA  students  graduate  with  under-developed  skills  to  properly  apply  the 
tools  and  techniques  they  have  been  exposed  to  at  AFTT.  This  is  because  curricula 
traditionally  have  emphasized  the  theoretical  development  of  cost  methods  more  than  real 
world  cost  estimating  applications.  Feedback  from  the  program  sponsor  indicates  that  the 
GCA  program  would  be  improved  if  the  current  curriculum  was  supplemented  with 
opportunities  to  apply  the  various  techniques. 
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Research  Objectives 

Cost  estimating  cases  presented  in  a  seminar  format  would  help  develop  the  skills 
of  the  students  to  properly  apply  cost  estimating  techniques  in  the  acquisition  arena.  As 
will  be  discussed  in  Chapter  n,  cost  estimating  cases  that  could  meet  this  problem 
currently  do  not  exist.  This  thesis  will  utilize  the  case  method  to  develop  educational 
cases  to  be  used  in  the  present  GCA  curriculum.  The  cases  will  be  presented  to  the  current 
GCA  students  in  the  summer  quarter  (1993)  seminar  class.  To  address  this  problem,  the 
objectives  of  the  research  effort  are  to: 

1.  Identify  the  cost  estimating  skills  that  graduates  of  the  AFTT  GCA  curriculum 
arc  expected  to  possess. 

2.  Assess  the  relative  importance  of  the  identified  cost  estimating  skills. 

3.  Select  weapon  system  scenarios  that  are  relevant,  interesting,  and  facilitate 
student  performance  of  identified  cost  estimating  skills. 

4.  Provide  cases  based  on  realistic  scenarios  that  will  facilitate  student  learning  of 
important  cost  estimating  skills. 

Scope  of  the  Research  Effort 

There  are  several  factors  which  will  shape  the  overall  scope  of  this  research  effort; 

1.  The  cases  will  focus  specifically  on  cost  estimating  applied  within  the 
acquisition  process.  Cost  analyses  performed  at  base-level  organizations  (i.e.,  economic 
analyses,  cost  benefit  analyses)  will  not  be  addressed.  Since  the  vast  majority  of  GCA 
graduates  are  placed  at  one  of  the  following  locations-the  Aeronautical  Systems  Center 
(ASC),  the  Space  and  Missile  Systems  Center  (SMC),  the  Electronic  Systems  Center 
(ESC),  and  the  Air  Force  Cost  Analysis  Agency,  the  cases  will  only  involve  scenarios  at 
these  locations. 


4 


2.  The  cases  will  focus  on  the  acquisition  of  Air  Force  weapon  systems  and  will 
not  address  acquisition  within  other  defense  departments  or  DoD  agencies. 

3.  The  cases  will  address  common  cost  estimating  tools  and  techniques  and  will 
not  address  tools  or  techniques  that  are  unique  to  one  specific  product  center. 

4.  Due  to  the  effort  involved  in  building  cases  and  the  amount  of  time  available  to 
implement  the  cases  in  the  seminar  class,  the  GCA  program  manager  decided  that  the 
construction  of  three  cost  estimating  cases  would  be  sufficient  (5). 

Thesis  Overview 

The  remainder  of  this  research  effort  will  seek  to  accomplish  the  specific  research 
objectives  established  earlier  in  this  chapter.  Chapter  n  consists  of  a  review  of  the 
relevant  literature  available  on  cost  estimating  skills,  the  case  writing  process,  as  well  as  a 
review  of  existing  cost  estimating  cases  in  the  DoD.  Chapter  in  describes  in  detail  the 
methodology  used  to  identify  pertinent  cost  estimating  skills  and  develop  the  cost 
estimating  cases.  Chapter  IV  provides  an  in-depth  analysis  of  the  overall  case 
development  process,  and  presents  the  results  of  our  efforts~the  student  cases.  Finally, 
Chapter  V  provides  a  summary  of  the  research  effort  and  final  conclusions  concerning  the 
cases. 
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n.  Literature  Review 


Overview 

This  chapter  provides  a  review  of  publications  and  other  literature  addressing  cost 
estimating  skills  and  the  case  method  of  instruction.  It  begins  with  a  rev  iew  of  the  existing 
literature  concerning  the  necessary  skills  of  cost  analysts.  This  is  followed  by  a  summary 
of  the  process  used  to  construct  educational  cases.  Cost  estimating  cases  currently  being 
used  in  DoD  education  and  training  will  then  be  reviewed  to  gain  any  insights  into  the  case 
development  process.  Finally,  the  case-method  of  instruction  will  be  introduced  as  the 
method  of  filling  the  application  gap  currently  existing  between  AFTT  instruction  and  the 
duties  expected  of  GCA  graduates. 

Cost  Estimating  Skills 

The  specific  duties  of  cost  analysts  who  graduate  firom  the  GCA  program  will  vary 
significantly  depending  on  their  assignments  following  graduation.  For  example,  a 
graduate  who  is  placed  in  one  of  the  program  offices  at  an  Air  Force  Materiel  Conunand 
(AFMC)  product  center  will  generally  be  responsible  for  estimating  the  cost  of  a  specific 
portion  of  a  weapon  system.  On  the  other  hand,  a  graduate  assigned  to  the  financial 
management  staff  of  a  product  center  will  have  responsibilities  ranging  from  conducting 
research  of  cost  models/estimating  tools  to  providing  cost  estimating  support  to  various 
program  offices.  Additionally,  AFTT  graduates  are  occasionally  placed  in  AFMC  Air 
Logistics  Centers  (ALCs)  or  assigned  to  the  AFMC  headquarters  staff-duties  at  these 
locations  are  significantly  different  than  those  already  mentioned.  For  instance,  a  cost 
analyst  assigned  to  an  ALC  will  often  be  heavily  involved  with  operation  and  support 
(O&S)  cost  estimating.  In  addition  to  job  assignment,  factors  such  as  the  type  of  weapon 
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system  and  the  phase  of  the  program  also  affect  the  application  of  cost  estimating 
techniques.  According  to  the  GCA  program  manager,  the  majority  of  cost  analysis 
graduates  are  placed  in  one  of  the  AFMC  program  offices  (6). 

The  amount  of  published  material  available  which  addresses  the  skills  required  of 
acquisition  cost  analysts  is  minimal-due  in  part  to  the  diversity  of  skills  required  at  the 
different  job  sites.  In  fact,  a  search  of  the  literature  revealed  only  two  documents  that 
specifically  addressed  the  range  of  acquisition  cost  estimating  skills  required  in  acquisition. 
These  are  1)  The  Air  Force  Systems  Command  Cost  Estimating  Handbook  (AFSC  Cost 
Handbook)  and  2)  a  report  prepared  by  the  Deputy  Assistant  Secretary  of  the  Air  Force, 
Plans,  Systems,  and  Analysis  (SAF/FMP),  subject  Training  Requirements  for  Acquisition 
Personnel  in  the  Business,  Cost  Estimating,  and  Financial  Management  Position 
Category. 

The  AFSC  Cost  Handbook  was  prepared  for  AFSC  (now  AFMC)  by  The 
Analytical  Sciences  Corporation  (T  ASC).  The  Handbook  consists  of  6  volumes.  Volume 
one  focuses  on  the  general  principles  of  cost  estimating,  providing  information  that  is 
equally  applicable  to  all  Systems  Command  cost  estimating  activities  and  organizations 
(8).  Volumes  two  through  six  are  specialized  publications  that  focus  on  the  unique 
aspects  of  the  various  product  centers  that  were  in  existence  at  the  time  the  Handbook 
was  created.  For  example,  volume  two  addresses  aeronautical  system  cost  estimating,  and 
chapter  five  addresses  missile  system  cost  estimating.  While  volume  one  identifies  cost 
estimating  techniques,  the  relative  importance  or  frequency  of  use  of  the  techniques  is  not 
addressed. 

The  SAF/FMP  report  also  presents  a  large  number  of  cost  estimating  skills,  but  in 
a  much  different  context  The  SAF/FMP  report  was  initiated  to  develop  course 
requirements  for  the  certification  of  acquisition  personnel  as  directed  by  the  Defense 
Acquisition  University  (DAU)  (9).  DAU  is  an  organization  which  works  with  consortium 
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schools  such  as  AFTT,  and  with  functional  boards  comprised  of  members  from  each 
service,  to  help  implement  the  Defense  Workforce  Improvement  Act  (DAWIA).  Cost 
estimating  is  one  of  three  tracks  which  will  be  listed  under  tl^  Business,  Cost  Estimating, 
and  Financial  Management  Functional  Board  in  DoD  S000.S2-M,  Career  Development 
Program  for  Acquisition  Personnel.  At  the  time  of  this  writing,  the  DAU  consortium 
schools  had  just  finished  their  review  of  cost  estimating  duties/tasks.  This  review  was 
accomplished  by  subject  matter  experts  from  program  offices,  product  center  staffs,  and 
cost  agencies  representing  each  of  the  three  services.  Unlike  the  AFSC  Cost  Handbook, 
the  DAU  study  does  not  provide  any  detailed  discussion  of  the  skills,  rather  it  singly  lists 
the  skills  targeted  for  eventual  inclusion  in  acquisition  financial  management  courses.  The 
DAU  study  presents  57  broad  cost  analyst  duties,  and  divides  them  into  detailed  sub  tasks. 

Twenty  six  of  the  57  skills  listed  in  the  DAU  study  are  also  addressed  in  the  AFSC 
Cost  Handbook.  Table  1  summarizes  the  26  shared  skills. 

TABLE  1 

Skills  Addressed  in  AFSC  Handbook  and  SAF/FMP  Report 


1 .  Prepare  life  cycle  cost  estimates. 

14.  Analyze  and  document  variances  or 
inconsistencies  in  cost  estimates. 

2.  Prepare  baseline  cost  estimates. 

IS.  Prepare  risk  analyses. 

3.  Prepare  independent  sovemment  cost  estimates. 

16.  Develop  and  analyze  acquisition  reports. 

4.  Develop  cost  data  to  be  used  in  developing  cost 

17.  Develop  inflation  factors. 

estimates  and  analysis. 

18.  Collect  and  analyze  operating  and  support  data. 

S.  Determine  cost  impacts  of  production  schedules. 

19.  Present  and  defend  cost  estimates  and  analyses. 

6.  Determine  cost  impacts  of  deployment  schedules. 

20.  Develop  cost  models. 

7.  Apply  learning  c'rrve  theory  to  develop  program 
cost  estimates 

21.  Develop  risk  models. 

8.  Develop  and  apply  work  breakdown  structures. 

22.  Perform  statistical/quantitative  analyses. 

9.  Evaluate  contractor  performarce  using  contractor 
reports. 

23.  Perform  parametric,  analogous,  and  engineoing 
analysis. 

10.  Analyze  costs  for  allowability,  allocability,  and 
reasonableness. 

24.  Develop  cost  estimating  relationships. 

11.  Perform  production  rate  analysis. 

25.  Evaluate  off-the-shelf  cost  models. 

12.  Convert  cost  estimates  from  constant/base-year 
dollars  to  current/then  year  dollars. 

26.  Develop  design  to  cost  estimates. 
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The  preceding  table  provides  an  overview  of  the  various  skills  required  of  acquisition  cost 
analysts.  Obviously,  each  of  the  above  skills  can  be  further  divided  into  several  n:K>te 
detailed  sub-tasks. 

Case  Method  of  Instruction 

The  Case  Method  Defined.  The  case  method  of  instruction  has  been  used 
extensively  by  business  schools  and  management  development  centers  as  a  tool  for 
training  managers.  The  first  book  of  written  cases  was  published  by  the  Harvard  Business 
School  in  1921  (10:13).  Although  it  was  originally  developed  in  the  United  States  some 
seventy  years  ago,  its  use  has  become  widespread  in  colleges  and  universities  throughout 
the  world  (11:99). 

The  case  method  is  a  system  of  instruction  built  on  the  premise  that  people 
arc  most  likely  to  retain  and  use  what  ti»y  leam  if  they  reach  understanding 
through  guid^  discovery.  Along  the  way,  trainees  refine  analysis  skills, 
develop  the  will  to  take  risks  in  the  face  of  uncertain  outcomes,  and  come 
to  know  their  own  strengths,  weaknesses  and  talents.  (12:46) 

One  distinction  that  must  be  made  is  the  difference  between  the  case  method  and  a  case 
study.  A  case  study  is  a  chronological  history  of  a  decision  situation,  with  a  coiiq>lete 
discussion  of  the  relevant  issues  and  the  outcome.  The  case  method,  on  the  other  hand, 
"is  more  like  an  editorial,  which  directs  the  reader  toward  a  way  of  thinking  about  an 
issue”  (12:46).  Thus,  while  a  case  study  presents  the  historical  solution  to  a  decision 
scenario,  the  case  method  leaves  the  solution  open  to  the  student's  individual  analysis  and 
interpretation.  The  case  method  is  a  technique  that  attempts  to  submerge  the  student  in 
the  environment  of  an  actual  organizational  decision  maker  and  forces  the  student  to  react 
as  if  the  situation  was  in  fact  the  real  thing  (13:69). 
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The  Case  Writing  Process.  There  have  been  innumerable  reviews,  critiques,  and 
analyses  published  concerning  the  case  method  of  instruction.  However,  compared  to  the 
plethora  of  information  which  addresses  the  use  of  the  case  method  of  instruction  in  the 
classroom,  considerably  less  has  been  written  on  how  a  case  should  actually  be 
constructed  and  written.  Provided  below  is  a  summary  of  the  major  steps  of  the  case 
writing  process  as  suggested  by  Michiel  R.  Leenders  and  James  A.  Erskine,  in  their  1989 
book  Case  Research:  The  Case  Writing  Process  (9:10-107). 

1.  The  Origin  of  the  Case~Setting  Learning  Objectives.  The  specific  formula 
for  initiating  the  case  subject  varies  in  relation  to  several  factc^:  the  author(s) 
background,  the  proposed  purpose  of  the  case,  and  the  educational  background  of  the 
targeted  students.  Regardless  of  the  impact  of  these  factors,  it  is  generally  accepted  that  a 
good  case  begins  with  the  development  of  appropriate  learning  objectives.  Additionally, 
the  development  of  learning  objectives  must  be  grounded  in  rescarch~the  writer  must  be 
concerned  with  his  understanding  of  the  practitioner's  problems  (9: 10).  Moreover,  it  is 
often  helpful  to  develop  learning  objectives  while  considering  specific  decisions  that  the 
writer  wants  the  student  to  be  faced  with.  For  example,  one  decision  for  a  cost  analyst 
may  involve  choosing  an  appropriate  estimating  methodology,  given  applicable  cost  data. 

2.  Establishing  Leads.  After  determining  the  required  learning  objectives,  the 
next  step  is  to  find  approachable  organizations  where  these  objectives  can  be  framed  in 
issues  which  the  organization  has  faced.  This  process  of  prospecting  for  potential  case 
scenarios  can  be  referred  to  as  establishing  leads.  It  is  important  during  this  phase  of  the 
process  to  be  open  to  all  potential  sources  of  information-functional  organizations, 
educational  branches,  and  informal  personal  contacts.  Often  the  best  source  for  a 
potential  scenario  is  to  go  directly  to  an  organization  and  talk  to  them  about  your  needs. 
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3.  Data  Collection.  Once  the  case  writer  or  case  writing  team  has  successfully 
established  contact  with  a  potential  source  of  information,  the  stage  is  set  for  data  to  be 
collected.  The  data  collection  process  must  be  sufficiently  planned  before  attempting  to 
gather  the  information.  An  outline  based  upon  the  targeted  learning  objectives  can  be 
instrumental  to  ensuring  all  of  the  necessary  data  is  obtained.  The  format  for  the  data 
collection  effort  should  focus  on  the  following  potential  sources: 

1 .  Published  data  outside  the  organization. 

2.  Internal  working  documents. 

3.  Personal  interviews  with  personnel  inside  the  target  organization.  (9:40) 

It  is  important  throughout  the  data  collection  effort  that  the  case  writer  focus  on  the 
substance  of  the  learning  objectives  or  decisions  that  the  case  will  attempt  to  simulate. 

4.  Content  After  the  relevant  data  is  collected,  it  is  s^propriate  for  the  case 
wiiterfs)  to  begin  constructing  drafts  of  the  case.  "Cases  can  vary  in  difficulty  from  short, 
one-page  descriptions  focusing  on  a  specific  micro  problem,  to  sequential  cases  which 
have  numerous  subparts  focusing  on  complex  issues  and  relationships"  (14:27).  The 
structure  of  a  written  case  is  highly  interpretive,  and  depends  on  several  factors  including 
the  degree  of  difficulty  of  the  targeted  learning  objectives,  the  amount  of  data  available 
(either  historical  data  or  data  that  can  be  simulated),  and  the  personal  writing  style  of  the 
case  writer.  In  any  case  writing  effort,  the  writer  must  continually  keep  the  perspective  of 
the  students  in  mind. 

The  student's  time  is  limited  and  even  though  data  in  the  real  world  are 
highly  disorganized  and  random,  [a  senior  cost  analyst]  has  a  way  of 
organizing  the  environment  that  he  or  she  has  built  him  or  herself,  whereas 
the  student  doesn’t.  So  to  give  the  student  a  fair  shake  and  a  decent 
decision,  you  have  to  organize  it;  no  magic  numbers  in  the  foomotes  etc.~ 
that  is  unfair.  Educationally,  it  gets  you  nowhere.  Highly  complex  cases 
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really  don't  do  that  much  for  the  student.  If  you  can't  say  it  in  ten  to  fifteen 
pages,  it's  probably  not  worth  saying.  (9:43) 

The  case  writer  must  be  familiar  with  the  experience  level  of  the  students. 

‘Students  with  little  or  no  background  in  the  subject  matter  will  require  more  prompting  in 
the  case  to  guide  the  student  in  the  decision  making  process.  How  much  guiding  is 
appropriate  is  a  subjective  decision  that  must  be  based  on  the  writer's  awareness  of  the 
students'  background.  Nevertheless,  there  are  a  few  general  pieces  of  information  that  are 
normally  included  in  every  case;  such  as  background  on  the  people,  the  problem,  and  the 
organization.  Once  again,  it  is  the  case  writer's  responsibility  to  determine  how  much 
background  material  is  needed  to  provide  setting  and  context  without  giving  so  much 
information  so  as  to  block  the  students  ability  to  understand  the  situation. 

5.  Presentation.  Presentation  is  different  from  content  in  that  presentation 
involves  determining  the  order  and  format  in  which  information  will  be  presented  to  the 
■student.  It  is  often  helpful  to  think  of  the  case  as  having  a  certain  structure  or  anatomy  of 
its  own  (9:47).  Time  structure  refers  to  the  time  sequence  in  which  the  business  situation 
takes  place.  The  case  can  be  organized  based  on  the  sequence  of  events  that  occurred  in 
the  organization.  In  any  event,  the  time  sequence  of  the  case  must  be  fairly  clear  to  the 
student.  Additionally,  there  is  a  narrative  structure  to  most  cases.  The  things  that 
happened  and  the  circumstances  of  their  occurrence  must  be  narrated  in  some 
understandable  pattern.  In  fact,  a  case  can  be  approached  like  a  play  that  opens  in  the 
middle  of  the  story  and  uses  flashbacks  to  describe  the  situations  that  led  up  to  the 
opening  scene  (12:46).  It  is  important  that  the  case  be  written  in  such  a  manner  as  to  hold 
the  student's  interest  and  motivate  him  or  her  to  perform. 

For  the  case  to  be  a  really  living  thing  and  for  the  student  to  forget  that  it's 
artificial,  there  must  be  drama,  there  must  be  suspense.  The  skillful  case 
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writer  will  build  this  up.  A  case  isn't  just  a  bland  narrative  where  there's  no 

question  or  issue.  (9:48) 

Concerning  the  order  in  which  information  is  presented  in  the  case,  it  is  often 
advisable  to  begin  with  an  opening  scene  or  situation,  focus  in  on  a  particular  problem, 
and  then  provide  the  appropriate  background  data  as  needed.  The  writing  process  should 
also  include  the  use  of  extensive  drafting,  editing  and  proofreading  to  ensure  the  case  is 
clearly  and  concisely  conqx>sed.  In  any  event,  the  process  of  writing  cases  varies 
considerably  from  person  to  person. 

Cost  Estimating  Cases  Currently  in  Use  by  DoD  Education  and  Training 
Institutions 

The  Army,  Navy  and  Air  Force  all  have  a  need  to  train  their  acquisition  cost 
analysts  in  the  various  skills  of  cost  estimating.  The  AFTT  Professional  Continuing 
Education  (PCE)  program  provides  the  largest  number  of  cost  estimating  training  courses 
in  the  Air  Force.  The  Army  conducts  the  majority  of  its  cost  estimating  training  through 
the  Army  Logistics  Management  College  (ALMC)  located  at  Fort  Lee,  Virginia.  The 
Navy,  on  the  other  hand,  utilizes  ALMC,  AFTT,  and  various  DoD  contractors  to  fulfill  its 
cost  training  requirements  (15). 

Ten  cost  analysis  courses  are  provided  through  the  AFTT  PCE  program,  ranging 
from  an  introduction  to  the  principles  of  cost  analysis  to  an  examination  of  advanced 
quantitative  techniques  (16:35-69).  Five  of  these  courses  use  some  type  of  cost  estimating 
case  to  allow  students  to  apply  the  concepts  taught  in  the  courses.  The  length  of  these 
courses  range  from  1  to  3  weeks.  Four  characteristics  were  developed  to  summarize  the 
content  of  the  cases: 

1.  Skills  -  Translates  the  case  tasking  into  specific  skills  (techniques  or  tools) 
students  must  understand  or  apply. 
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2.  Phase  -  Lists  the  phase(s)  of  the  targeted  acquisition  program  that  the  student  is 
responsible  for  estimating. 


3.  Case  Format  -  Briefly  describes  the  flow  of  the  case. 

4.  Scenario  -  Describes  the  setting,  if  any,  in  which  the  case  takes  place.  Also 
describes  the  type  of  system  being  estimated. 

Table  2  summarizes  the  characteristics  for  each  case.  Definitions  of  all  acronyms 
and  terms  that  may  be  unclear  to  the  reader  can  be  found  in  appendix  A. 

As  shown  in  Table  2,  each  case  has  its  own  unique  characteristics  that  define  its  content. 
The  most  notable  differentiation  that  can  be  made  between  the  cases  concerns  the  amount 
of  realism  injected  in  the  cases.  The  SYS  227  and  QMT  SSI  cases  provide  detailed 
program  and  system  background  data  to  give  the  student  a/ee/  for  the  system  and 
program.  The  other  cases  make  no  real  attempt  at  this  effort.  Additionally,  none  of  the 
cases  use  dialogue  to  bring  the  case  to  life.  In  fact,  all  of  the  cases  have  instructional 
guidance  embedded  in  the  cases,  which  serves  as  a  constant  reminder  to  the  student  that 
this  is  indeed  an  artificial  scenario.  This  lack  of  realism  may  be  due  in  part  to  the 
environment  in  which  these  cases  are  administered.  Each  case  represents  only  a  subset  of 
the  overall  learning  experience  targeted  for  the  courses.  Thus  the  cases  are  not  meant  to 
stand  alone  as  instructional  tools.  It  should  be  noted  that  the  QMT  551  cases  were 
developed  by  an  independent  consultant.  The  remainder  of  the  cases  were  developed  in- 
house  by  the  AFTT  PCE  faculty.  Also,  student  feedback  on  the  QMT  551  cases  has 
revealed  significant  shortcomings  of  these  cases.  Specifically,  there  are  many  logical 
discontinuities  in  the  data,  as  well  as  some  data  inconsistencies  identified  by  the  PCE 
staff  (17). 
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TABLE  2 

Summary  of  Existing  Cost  Estimating  Cases 


QMT175 
Principles  of 
Cost  Analysis 

Spreadsheet  building 
Learning  curves 

CER  building 
Regression  analysis 
Wrap  rates 
Documenution 

Production 

Case  broken  into 
estimating  sections 
which  list  specific  data. 

No  opening  scenario 
provided. 

Case  involves  a 
theoretical  cargo 
aircraft. 

QMT  345 
Quantitative 
Techniques  for 
Cost  and  Price 
Analysis 

Data  normalization 
Regression  analysis 
CER  building 

Overhead  rates 
Statistics 

Time  series  analysis 

Production 

Case  broken  into 
estimating  sections 
which  list  specific  data. 
Student  guidance 
provided  throughout. 

A  simulated  tasking 
letter  from  the  cost 
estimating  chief  opens 
the  case.  C^ase  involves 
a  theoretical  missile. 

SYS  227 
Financial  Mgt 
in  Weapon 
System 
Acquisition 

WBS  development 

Data  normalization 
Learning  curves 
Spreadsheet  building 
Complexity  factors 
Time  phasing 

Production 

Case  broken  into 
sections  which  list 
specific  data.  Detailed 
system  background  and 
student  guidance 
provided. 

A  simulated  program 
management  directive 
is  provided  to  open  the 
case.  Case  involves  a 
theoretical  air-to-air 
missile. 

QMT  551 
Advanced  Cost 
and  Economic 
Analysis 

Data  normalization 
Learning  curves 
Complexity  factors 

Cost  mode! 
application 

Life  cycle 
estimate 

Opens  with  learning 
objectives.  Extremely 
detailed  system  and 
program  background. 

No  opening  scenario. 
Case  involves  a 
theoretical  fighter 
aircraft. 

ALMCCase 

(Bradley 

Fighting 

Vehicle 

Scenario) 

Cost  factor  cross¬ 
check 

CER  development 

O&S 

Opens  with  program 
status.  Provides  Case 
requirements  and  gives 
cost  data. 

No  real  scenario.  No 
flow  throughout  the 
case.  Case  involves  the 
Bradley  Fighting 

Vehicle. 

ALMCCase 
(Hawk  Missile 
Scenario) 

CER  development 
Statistical  tests 

Data  normalization 
Time  phasing 

Learning  curves 

Production 

Opens  with  system 
background.  Provides 
assumptions  and  case 
requirements. 

No  scenario  given. 
Simply  states  program 
background  and 
provides  CER  data. 

Summary 

This  chapter  reviewed  literature  and  publications  related  to  cost  estimating  skills 
and  the  case  development  process.  Additionally,  several  cost  estimating  cases  currently 
being  used  in  the  Air  Force  were  examined.  This  literature  review  revealed  three 
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important  themes:  First,  there  is  a  wide  variety  of  cost  estimating  skills  that  need  to  be 
addressed  through  formal  education  and  training.  Second,  the  case  development  process 
is  highly  subjective,  and  should  be  tailored  to  meet  the  specific  needs  of  the  case  writer(s). 
Additionally,  any  case  writing  effort  should  begin  with  the  development  of  specific 
learning  objectives.  Lastly,  there  is  a  need  for  realistic  cases  to  be  developed  that  can 
provide  students  with  an  opportunity  to  practice  the  application  of  cost  estimating 
techniques  in  an  environment  that  simulates  the  acquisition  arena.  The  use  of  cases  that 
are  realistic  and  stimulating  to  the  student  can  bridge  the  gap  that  currently  exists  between 
academia  and  the  real  world. 


in.  Methodology 


Overview 

This  chapter  discusses  the  methodology  used  for  this  research  effort.  Research 
was  conducted  in  three  phases.  The  first  phase  involves  identification  of  cost  estimating 
skills  to  be  addressed  in  cases.  The  second  phase  consists  of  a  questionnaire  directed  at 
the  product  centers  and  the  Air  Force  Cost  Analysis  Agency  (AFCAA)  to  meet  four 
objectives:  (1)  validate  and  refine  the  identified  skills  as  needed,  (2)  rank  the  relative 
importance  of  the  identified  skills  and  (3)  obtain  leads  on  potential  weapon  system 
scenarios  for  cases,  and  (4)  based  on  the  questionnaire,  select  skills  to  be  used  in  the  cases. 
•The  third  and  final  phase  concerns  the  development  of  the  targeted  cases. 

Phase  1:  Identification  of  Cost  Estimating  Skills  to  be  Addressed  in  Cases 

The  purpose  of  this  phase  was  to  develop  a  tentative  list  of  cost  estimating  skills  to 
use  as  a  baseline  for  the  follow-on  field  questionnaire.  This  list  of  skills  would  then  be 
sent  to  the  product  centers  and  the  AFCAA  to  provide  them  with  a  baseline  for 
determining  which  cost  estimating  skills  they  perceived  to  be  most  important.  Skills  were 
identified  using  two  activities:  (1)  a  brainstorming  session  between  the  thesis  authors  and 
(2)  personal  interviews  with  experienced  cost  estimating  personnel.  The  AFSC  Cost 
Handbook  provided  the  starting  point  for  the  brainstorming  effort,  as  each  chapter  of  the 
handbook  was  reviewed  for  potential  cost  estimating  skills.  The  result  of  the 
.brainstorming  session  was  an  initial  list  of  35  potential  skills,  the  majority  of  which  came 
directly  from  the  AFSC  Cost  Handbook. 

The  next  step  was  to  validate  the  brainstormed  list  by  discussing  the  list  with 
experienced  cost  estimators.  The  advisors  for  this  thesis  effort  (Major  Wendell  Simpson 
and  Captain  Tom  Tracht)  were  selected  for  their  backgrounds  in  the  estimating  arena. 
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Additionally,  the  advisors  had  estimating  experience  with  two  of  the  three  existing  product 
centers,  thus  providing  additional  insights  into  potential  product  center  unique  skills.  The 
result  of  these  discussions  was  an  expanded  list  of  cost  estimating  skills  to  be  used  as  the 
baseline  for  the  follow-on  questionnaire.  These  skills  were  restructured  as  specific 
objectives  to  better  clarify  the  context  within  which  the  skills  will  be  applied.  Provided 
.below  is  a  summary  of  the  objectives  that  were  selected  for  the  questioimaire. 

1 .  Prepare  appropriate  cost  estimating  documentation. 

2.  Develop  computer  spreadsheets  to  automate  weapon  system  cost  estimating. 

3.  Utilize  normalization  techniques. 

4.  Understand  the  various  time-phasing  techniques. 

5.  Interpret  cost  performance  reports. 

6.  Choose  an  appropriate  methodology  and  perform  a  cross-check. 

7.  Understand  the  purpose  and  uses  of  a  work  breakdown  structure  (WBS). 

8.  Use  a  parametric  methodology  in  developing  a  cost  estimate. 

9.  Use  the  analogy  method  in  developing  a  cost  estimate. 

10.  Use  a  grass  roots  methodology  in  developing  a  cost  estimate. 

1 1 .  Summarize  the  elements  that  comprise  an  operating  and  support  cost  estimate. 

12.  Understand  the  elements  that  comprise  Other  Government  Costs  (OGC)  and 
their  impact  on  the  total  weapon  system  cost  estimate. 

13.  Compute  cost  risk  using  a  given  model. 

14.  Prepare  an  estimate  briefing  for  a  milestone  review. 

15.  Compare  cost  estimates  to  budget  available  and  develop  possible  course  of 
action  (what-ifs)  to  reconcile. 
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16.  Explain  the  purpose  and  use  of  initial  spares. 

17.  Construct  wrap  rates. 

^  18.  Know  the  elements  that  comprise  a  Cost  Analysis  Requirements  Document. 

Phase  2:  Product  Center  and  AFCAA  Questionnaire 

As  stated  in  the  introduction,  this  phase  consisted  of  the  development  of  a 
questionnaire  to  satisfy  the  four  objectives  discussed  below.  The  questionnaire  was 
distributed  to  the  Director  of  Cost  for  each  of  the  product  centers  as  well  as  the 
Commander  of  the  Air  Force  Cost  Analysis  Agency  (AFCAA).  The  questioimaire 
requested  that  a  broad  spectrum  of  cost  analysts  be  selected  to  respond  to  respond  to  the 
questioimaire.  Specifically,  it  was  suggested  that  questioimaire  participants  reflect  the 
range  of  estimating  experience  (junior  to  senior).  Additionally,  a  mix  of  mihtary  and 
civilian  personnel,  along  with  inclusion  of  at  least  one  prior  GCA  graduate,  was  requested. 
A  copy  of  the  questionnaire  is  provided  in  Appendix  C. 

Objective  1  -  Validate/Refine  Skills.  Each  of  the  organizations  surveyed  were 
requested  to  review  and  comment  on  the  skills  proposed,  and  add  any  additional  skills  not 
already  identified. 

Objective  2  -  Rank  Skills.  Each  of  the  organizations  surveyed  were  requested  to 
rank  the  relative  importance  of  the  cost  estimating  skills,  including  any  additional  skills 
identified  by  the  agency.  This  ranking  was  accomplished  by  numerically  ordering  the 
skiUs.  For  example,  if  the  fifth  skill  on  the  list  was  the  most  important,  it  should  have  been 
ranked  number  1 .  The  second  most  important  skill  listed  should  then  have  been  ranked 
with  the  number  2,  etcetera. 

Objective  3  -  Obtain  Leads  on  Weapon  System  Scenarios.  Since  realism  was 
determined  to  be  a  significant  element  of  the  case  development  process,  it  was  determined 
that  the  selection  of  relevant  and  interesting  weapon  system  programs  was  important  to 
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the  research  effort.  Therefore  each  of  the  surveyed  organizations  was  requested  to 
provide  possible  leads  on  weapon  system  programs  that  they  felt  would  provide  interesting 
backdrops  for  a  case,  as  well  as  adequate  data. 

Objective  4  -  Select  Skills  to  be  Used  in  Cases.  The  results  of  the  questionnaire 
were  analyzed  to  determine  which  skills  were  most  important  for  inclusion  in  the  cases. 
Obviously  not  all  relevant  cost  estimating  skills  could  be  addressed,  so  the  organizations' 
rankings  of  the  skills  were  used  to  differentiate  the  skills  that  were  fmally  selected. 
Specifically,  those  skills  representing  the  top  50%  of  rankings  from  all  of  the  field  agencies 
surveyed  were  selected  for  inclusion  in  the  cases.  These  skills  were  also  cross-checked 
against  the  SAF/FMP  report  as  an  additional  measure  of  skill  validity.  A  draft  copy  of  the 
SAF/FMP  report  was  used  for  this  cross-check  as  the  final  report  was  not  yet 
available  (16). 

Phase  3:  Develop  Cases 

This  phase  consisted  of  6  tasks: 

1)  Select  weapon  system  programs  to  use  as  case  scenarios. 

2)  Develop  learning  objectives  for  each  scenario  based  on  identified  skills. 

3)  Write  the  cases. 

4)  Develop  solutions  for  the  cases. 

5)  Develop  teaching  plans  for  the  cases. 

6)  Evaluate  the  cases. 

Task  1  -  Select  Weapon  System  Programs  to  Use  as  Case  Scenarios.  This  task 
began  with  the  construction  of  criteria  to  judge  the  usefulness  of  the  possible  weapon 
system  scenarios.  The  criteria  selected  were  1)  data  availabUity,  2)  program  phase,  3) 
estimating  environment,  and  4)  age  of  the  program.  Data  availability  addresses  two 
questions.  First,  is  the  data  accessible  (i.e.,  is  it  classified  or  sensitive)?  If  the  data  is 
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accessible,  is  it  convenient  to  retrieve?  For  example,  is  the  data  available  in  the  local  area, 
or  is  it  stored  in  another  part  of  the  country?  The  second  criteria,  program  phase,  refers  to 
the  weapon  system's  position  in  the  acquisition  process  (e.g.,  the  concept  exploration 
phase).  This  step  seeks  to  identify  weapon  system  scenarios  that  represent  different 
phases  of  the  acquisition  process,  so  that  students  will  be  exposed  to  a  wide  range  of 
estimating  situations.  Estimating  enviromnent  identifies  the  organizations  involved  with 
the  estimating  effort  (i.e.,  AFCAA  or  one  of  the  product  centers)  and  the  type  of  system 
(e.g.,  aircraft  or  electronic  system,  for  example).  The  last  criteria  provides  a  measure  of 
how  current  the  weapon  system  is,  based  on  when  the  program  was  initiated  and  whether 
it  is  still  on-going. 

In  addition  to  the  questiormaires,  personal  contacts  from  two  of  the  product 
centers  were  established  to  identify  possible  scenarios.  Mr  John  Allen,  former  Chief  of  the 
ASC  Cost  Analysis  Avionics  Branch  (ASC/FMCC)  (18),  and  Captain  Tracht,  former 
analyst  on  the  SMC  Cost  Analysis  Staff,  provided  input  to  this  process  (19).  After 
receiving  a  list  of  potential  scenarios  from  Mr  Allen,  research  was  conducted  at  the  ASC 
Cost  Library  to  determine  if  the  scenarios  satisfied  the  criteria  stated  above.  Captain 
Tracht  identified  one  program  that  satisfied  all  of  our  criteria.  The  author's  (Captain 
Kerrie  Schieman)  personal  experience  in  weapon  system  acquisition  was  also  useful  in 
identifying  possible  programs.  Based  on  the  program  data  collected,  specific  weapon 
system  scenarios  were  selected. 

Task  2  -  Develop  Learning  Objectives  for  Each  Case  Based  on  Identified  Skills. 
Bloom's  taxonomy  was  used  to  translate  the  cost  estimating  skills  identified  by  the  field 
questionnaire  iUiO  learning  objectives  (20:201-207).  For  example,  the  skill  of  analogous 
estimating  was  translated  to  use  an  analogous  methodology.  Care  was  taken  to  match 
skills  to  the  scenarios  based  on  the  phase  of  the  program  and  the  data  available.  For 
instance,  the  skill  of  parametric  estimating  was  matched  to  the  weapon  system  scenario 


21 


that  involved  the  concept  exploration  phase  of  the  acquisition  process,  as  this  is  the  time¬ 
frame  where  parametric  estimating  is  most  often  utilized. 

^Task  3  -  Write  the  Cases.  This  task  was  approached  with  a  7  step  process 
developed  by  the  authors  based  on  their  review  of  the  case  writing  literature  presented  in 
chapter  2.  The  first  three  steps  included  the  development  of  the  scenario,  program 
background,  and  system  description.  These  three  elements  provide  the  framework  for  the 
.entire  case,  and  thus  can  be  referred  to  as  the  setting  of  the  case.  The  remaining  steps 
provide  the  student  with  all  of  the  supporting  documentation  required  to  take  the  student 
through  the  learning  objectives.  These  steps  include  development  of  the  acquisition  plan, 
ground  rules  and  assumptions,  tasking,  and  supporting  data.  These  elements  comprise  the 
bulk  of  the  analysis  and  thus  can  be  referred  to  as  the  content  of  the  case. 

Data  collection  sheets  were  used  to  construct  the  overall  layout  of  each  case  (21). 
These  data  collection  sheets  were  modified  by  the  authors  to  coincide  with  their  case 
writing  approach.  A  sample  data  collection  sheet  modified  for  this  research  effort  is 
provided  in  Appendix  D.  The  setting  was  important  to  each  case  as  it  served  three  basic 
purposes:  1)  inspire  student  interest  in  the  case,  2)  inject  realism  into  the  case,  and  3) 
provide  necessary  background  information.  The  content  of  the  case  is  obviously  crucial  as 
the  student  caimot  accomplish  the  learning  objectives  without  this  information.  A  large 
portion  of  this  data  was  extracted  (and  subsequently  masked)  from  cost  estimating 
documentation.  However,  a  smaller  amount  of  content  information  had  to  be  contrived  by 
the  authors.  The  writing  process  itself  iterated  between  writing  the  content  and  writing 
the  setting.  For  example,  the  development  of  supporting  cost  data  for  a  case  often 
resulted  in  many  changes  to  the  previously  drafted  background  and  ground 
rules/assumptions  sections.  Thus  several  drafts  of  each  case  were  constructed  before  a 
final  case  could  be  completed. 
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Task  4  -  Develop  Solutions.  Developing  solutions  involved  executing  the 
specific  tasks  outlined  in  each  case.  It  should  be  noted  that  the  cases  require  judgments  by 
the  students.  The  solutions  constitute  the  authors'  perception  of  the  best  answers  to  the 
issues  presented  in  the  cases.  These  solutions  should  not  be  considered  the  only  answers- 
cost  estimating  is  a  creative  process  and  different  answers  to  problems  can  be  devel(^)ed 
based  on  the  individual  analyst's  experience  and  judgment  The  development  of  solutions 
resulted  in  cosmetic  changes  to  the  cases  based  on  the  insights  gained  by  actually 
performing  the  case. 

Task  5  -  Develop  Teaching  Plans.  The  case  method  of  instruction  involves  more 
than  the  development  and  implementation  of  cases.  Students  must  be  provided  with  the 
necessary  tools  and  techniques  before  executing  a  case.  Thus  the  case  method  of 
instruction  can  use  several  different  instrucdonal  vehicles  to  complement  the 
accomplishment  of  the  desired  learning  objectives.  One  such  vehicle  is  the  teaching  plan. 
The  format  of  the  teaching  plans  was  developed  based  on  input  from  the  GCA  program 
manager  (6).  Specifically,  four  sections  were  developed- 1)  learning  objectives,  2) 
resources  required,  3)  topics  to  be  discussed,  and  4)  possible  sources. 

The  learning  objectives  consisted  of  the  objectives  previously  established  for  each 
case.  The  second  section  of  the  teaching  plan  informs  the  instructor  what  types  of 
resources  the  student  needs  to  accomplish  the  stated  learning  objectives.  For  example,  the 
use  of  computers,  specific  software  packages,  and  other  analytical  tools.  The  third 
section,  topics  to  be  discussed,  delineates  those  areas  which  students  need  to  understand 
before  being  able  to  execute  the  case.  Hnally,  as  an  additional  benefit  to  the  instructor, 
potential  sources  of  information  were  provided.  For  instance,  publications  were  listed 
which  address  the  various  topics.  The  teaching  plans  for  each  case  are  provided  in 
chapter  four. 


23 


Task  6  -  Evaluate  Cases.  The  cases  were  evaluated  based  on  four  criteria:  clarity, 
realism,  difficulty,  and  student  learning.  These  criteria  were  selected  based  on  their  ability 
to  measure  the  overall  effectiveness  of  each  case.  The  first  criteria,  clarity,  attempts  to 
define  the  comprehensibility  of  the  case~i.e.,  can  the  student  understand  the  requirements 
of  the  case  and  determine  how  to  meet  those  requirements?  Student  input  was  used  to 
measure  this  criteria.  Specifically,  after  the  final  draft  of  each  case  was  completed,  two 
students  were  asked  to  review  the  clarity  of  the  case.  The  two  students  were  selected 
based  on  their  experience  with  acquisition  cost  ^timating.  For  each  review  an 
experienced  and  inexperienced  student  was  chosen.  This  reduced  the  amount  of  bias  that 
could  be  introduced  by  the  student's  past  experience  or  lack  of  experience.  Student 
feedback  was  provided  in  the  form  of  a  questionnaire  (Appendix  E)  designed  to  evaluate 
the  cases'  overall  clarity.  Student  feedback  was  analyzed  by  using  summary  tabulations. 

The  second  criteria,  case  realism,  refers  to  the  case's  ability  to  simulate  the 
acquisition  cost  estimating  environment.  A  questionnaire  of  subject  matter  experts  was 
used  to  measure  this  criteria.  This  questionnaire  was  distributed  to  the  Director  of  G>st 
for  each  of  the  product  centers,  the  AFMC  Director  of  Cost,  and  to  the  Commander  of 
the  Air  Force  Cost  Analysis  Agency.  The  questionnaire  was  designed  to  determine  how 
well  each  of  the  various  sections  of  the  case  (i.e.,  scenario,  ground  rules/assunqitions, 
background)  mirror  actual  situations  that  occur  in  the  acquisition  environment.  It  should 
be  noted  that  these  surveys  were  informal  in  the  sense  that  they  consisted  of  open  ended 
questions  designed  to  solicit  narrative  feedback.  These  were  not  ftmnal  surveys  designed 
to  solicit  response  data  that  could  characterize  some  population— instead,  they  were 
designed  to  get  feedback  from  specific  organizations.  A  copy  of  the  questiormaire  is 
provided  in  Appendix  F.  To  summarize  the  results  of  the  questionnaire  a  descriptive 
meta-matrix  analysis  was  employed.  "Meta-matrices  are  master  charts  assembling 
descriptive  data  from  each  of  several  sites  in  a  standard  format"  (22: 152).  The  basic  idea 
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of  a  meta-matrix  is  to  include  all  relevant  data— they  are  especially  useful  when 
summarizing  descriptive  data  from  multiple  sites  (22: 1S2). 


The  third  criteria,  case  difficulty,  was  collected  in  the  fonn  of  a  questionnaire  that 
evaluated  the  student's  perception  of  the  overall  difficulty  of  the  case.  The  questicmnaire 
attenqHed  to  quantify  difficulty  by  measuring  the  anx>unt  of  time  students  spent  on  the 
case  and  their  perception  of  case  complexity.  The  median  value  for  the  hours  spent  and 
the  median  value  for  the  complexity  ratings  were  calculated  to  develop  composite  rankings 
of  case  difficulty.  Frequency  distributions  were  also  developed  to  illustrate  the  range  of 
time  spent  on  each  case.  An  assessment  of  case  difficulty  is  inq)oitant  because  a  case  that 
is  overly  simplistic  can  diminish  its  overall  effectiveness.  Additionally,  a  case  that  is  too 
taxing  can  result  in  significant  student  frustration  and  subsequently  impede  learning.  A 
copy  of  the  questionnaire  is  provided  in  Appendix  G. 

The  final  criteria  used  to  analyze  the  cases  was  student  learning.  Student  learning 
attempts  to  determine  whether  or  not  the  students  met  the  desired  learning  objectives  of 
the  cases.  The  device  used  to  measure  learning  was  the  student  solutions  required  by  each 
case.  Each  student's  solution  was  evaluated  by  the  authors  to  determine  if  the  various 
techniques  embedded  within  the  learning  objectives  were  properly  demonstrated. 
Specifically,  if  the  solutions  demonstrated  the  students  developed  logical  methodologies 
and  executed  them  properly,  then  it  was  surmised  that  student  learning  occurred. 

Summary 

This  chapter  presented  the  methodology  used  in  conducting  this  research  effort. 
Three  phases  of  research  were  introduced.  The  first  phase  outlined  the  various  steps  used 
to  identify  cost  estimating  skills  to  be  addressed  in  the  cases.  Second,  the  methodology 
used  to  survey  several  cost  estimating  organizations  throughout  the  Air  Force  was 
described.  Finally,  the  six  step  approach  used  to  develop  the  cases  was  outlined. 
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rv.  Analysis  and  Results 


Overview 

Tliis  chapter  presents  the  results  of  building  three  cost  estimating  cases  for  use  in 
the  summer  quarter  1993  GCA  seminar  course  at  AFTT.  First,  specific  skills  (expressed  in 
the  form  of  learning  objectives)  were  analyzed  and  selected  for  use  in  the  cases.  Second, 
wetqxm  system  programs  were  identified  and  selected  for  use  as  the  background  for  the 
three  cases.  Finally,  the  results  of  the  case  development  process~the  final  cases  with 
solutions,  along  with  an  analysis  of  the  results  of  implementing  the  cases~are  presented. 
Each  of  these  efforts  follows  the  methodology  delirteated  in  Chapter  m. 

Selection  of  Cost  Estimating  Skills  to  be  Addressed  in  Cases 

As  described  in  Chapter  m,  this  effort  began  with  the  use  of  various  reference 
documents,  brainstorming,  and  personal  interviews  with  experienced  estimators.  After 
several  iterations  a  composite  list  of  skills  was  developed  and  transformed  into  specific 
learning  objectives.  These  objectives  were  then  sent  to  various  cost  estimating 
organizations  for  review.  Eighteen  major  skills  were  outlined  in  the  questionnaire  and  the 
respondents  ranked  them  from  1  (most  important)  to  18  (least  important).  They  were  also 
given  the  opportunity  to  add  any  additional  skills  not  already  identified. 

Twenty  questionnaires  were  returned  from  the  various  product  centers  and 
AFCAA.  Table  3  summarizes  the  number  of  responses  from  each  of  the  field  agencies. 


TABLES 

Learning  Objective  Questionnaire  Responses 


AFCAA 

ASC 

ESC 

SMC 

11* 

5 

0 

4 

*  Four  of  the  AFCAA  respondents  did  not  rank  the  objectives  in  the  manner  specified  in 
the  questiormaire.  This  input  was  reviewed  but  not  included  in  the  final  questiormaire 
results  since  the  data  could  not  be  normalized  to  correspond  with  the  other  inputs. 
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To  summarize  the  questionnaire  results  a  composite  score  was  calculated  for  each 
objective.  First,  each  objective  was  evaluated  by  summing  the  amount  of  number  one 
rankings,  number  two  rankings  and  so  on.  The  next  step  was  to  apply  the  weighted 
ranking  to  the  objectives.  For  example,  if  an  objective  received  four  number  one  rankings 
then  the  weighted  ranking  would  be  72  (4*  18)--based  on  the  18  total  skills.  These 
rankings  were  then  summed  for  all  objectives  to  arrive  at  composite  scores.  The 
spreadsheet  used  to  perform  the  above  calculations  is  provided  in  Appendix  H.  The  final 
results  were  compared  and  summarized  in  Figure  1.  A  short  description  of  each  objective 
is  provided  in  Table  4  for  reference  (a  detailed  description  can  be  found  in  Appendix  C). 

As  requested  in  the  questionnaire,  several  of  the  respondents  provided  additional 
skills  they  felt  were  in^rtant,  but  were  not  included  in  the  questioimaire.  The  skills 
identified  were:  how/when  to  use  software  models,  how  to  perform  data  collection,  and 
understanding  the  technical  aspects  of  a  weapon  system  program.  Though  these  skills  are 
important  they  were  not  included  in  the  selection  process  for  the  following  reasons.  First, 
the  GCA  curriculum  already  includes  a  four  credit  hour  class  on  software  estimating.  This 
class  provides  the  student  with  a  detailed  background  of  all  software  models  available  and 
their  applicability.  Additionally,  the  class  has  several  software  estimating  cases  where  the 
students  must  run  the  different  software  models  and  compare  and  contrast  the  model 
results.  Second,  data  collection  is  an  area  which  is  extremely  difficult  to  simulate  in  the 
classroom  setting.  The  process  of  data  collection  varies  significantly  depending  on  the 
estimating  envirorunent.  Specifically,  it  is  difficult  to  interpret  data  without  having  the 
personal  insights  of  the  experts  who  were  involved  in  the  program  under  study. 
Additionally,  data  collection  is  already  practiced  in  the  GCA  program's  two  regression 
classes.  Moreover,  the  AFTT  thesis  program  requires  most  students  to  practice  data 
collection  in  support  of  their  research.  While  data  collection  is  an  important  skill,  it  is  one 
which  is  best  developed  through  experience.  Finally,  learning  the  technical  aspects  of  the 


program  is  an  important  aspect  of  cost  estimating,  but  one  that  is  also  difficult  to  simulate. 
Providing  a  plethora  of  technical  information  would  not  add  to  the  validity  of  the  case,  and 
may  even  detract  from  the  case.  As  discussed  in  Chqiter  n,  an  exceedingly  difficult  case 
only  frustrates  the  student.  This  is  another  skill  that  perhaps  is  best  learned  through 
experience  in  the  program  office  environment. 


#6  Cross-check 

#1  Document  preparation 

1 '] 

#7WBS 

#3  Data  normalization 

#17  Wrap  rates 

#14  Brieflngs  I 

#2  Spreadsheet  automation 

#9  Analogy  estimate 

#8  Parametric  estimating 

#10  Grass  roots  estimate 

#4  Time  phasing 

#13  Risk  analysis 

#5  ascsc 

*  Recall  that  these  objectives  contain  several  sub-tasks,  as  presented  in  Appendix  C. 
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All  the  identified  skills  were  compared  to  the  skills  listed  in  the  draft  SAF/FMP 
report  as  a  cross-check  of  skill  validity.  All  of  the  objectives  identified  in  the  questionnaire 
were  in  fact  present  in  the  SAF/FMP  report.  Thus  the  SAF/FMP  report  did  not  suggest 
elimination  of  any  skills  identified  in  the  questionnaire. 

The  last  step  involved  taking  the  questionnaire  results  and  determining  which 
specific  skills  should  be  included  in  the  cases.  As  discussed  in  Chapter  m,  the  top  50% 
(nine  skills)  were  selected  to  form  the  minimum  number  of  skills  to  be  addressed  in  the 
cases.  Note  that  risk  analysis  (ranked  number  five)  and  grassroots  estimating  (ranked 
number  nine)  were  not  selected.  The  GCA  curriculum  already  has  a  class  dedicated  solely 
to  risk  (which  includes  a  case  problem).  Therefore,  risk  analysis  was  eliminated  from  the 
list  of  skills  to  implement.  Grassroots  estimating  was  eliminated  due  to  the  exorbitant 
amount  of  supporting  data  required  to  execute  this  methodology.  After  eliminating  risk 
and  grassroots,  16  objectives  remained.  The  top  50%  (eight  skills)  were  selected.  Tl» 
remaining  skills  were  used  in  the  cases  if  it  was  convenient  to  include  them.  For  example, 
time-phasing  techniques  (spread  of  dollars  over  the  life  of  a  program)  is  easily 
implemented,  and  thus  was  included  in  more  than  one  case.  Of  the  sixteen  skills  only  five 
were  not  included  in  any  of  the  cases—indicated  by  asterisks  in  Table  4.  Final  learning 
objectives  for  each  case  were  developed  from  the  tasks  and  are  presented  in  the  teaching 
plans  displayed  later  in  this  chapter. 


Weapon  System  Program  Selection 

As  stated  previously,  this  effort  included  two  research  steps;  1)  solicitation  of 
leads  on  potential  weapon  system  scenarios  from  the  product  centers  and  the  AFCAA,  and 
2)  personal  interviews  of  experienced  cost  analysis  personnel. 
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Solicitation  of  Product  Centers  and  AFCAA.  The  questionnaire  which  formed  the 
basis  for  this  solicitation  proved  to  be  unfruitful.  Specifically,  none  of  the  organizations 
surveyed  provided  input  on  potential  scenarios  to  use  in  the  cases.  As  a  result,  alternative 
sources  of  estimating  scenarios  were  investigated. 

Personal  Interviews  with  Experienced  Cost  Analysis  Personnel.  Personal 
interviews  proved  to  be  highly  effective  in  identifying  candidate  scenarios.  Mr  John  Allen 
and  Captain  Tom  Tracht  identified  several  potential  weapon  system  programs  for  use  in 
the  cases.  These  potential  programs  were  then  researched  at  the  ASC  Cost  Library  to 
determine  if  the  scenarios  met  the  criteria  stated  in  Chapter  HI.  Table  5  summarizes  the 
results  of  the  analysis  of  the  various  programs.  Using  Table  5,  three  weapon  system 
programs  were  selected  for  use  in  the  cost  estimating  cases:  LANTIRN  (Low- Altitude 
Navigation  Targeting  Infrared  for  Night),  C-17,  and  SBWAS  (Space  Based  Wide  Area 
Surveillance).  The  LANTIRN  program  was  selected  primarily  due  to  the  availability  of 
extensive  cost  estimating  documentation  found  in  the  ASC  Cost  Library.  Additionally,  the 
cost  estimating  methodology  used  in  the  documentation  allowed  for  the  tailoring  of  the 
estimating  environment.  Specifically,  an  Independent  Cost  Analysis  (ICA)  using  an 
analogous  methodology  was  performed  on  the  LANTIRN  system  by  a  DoD  contractor. 
This  made  it  relatively  easy  to  modify  the  scenario  to  occur  at  the  Air  Force  Cost  Analysis 
Agency  (AFCAA),  where  the  accomplishment  of  all  Air  Force  ICAs  (recently  replaced  by 
the  term  Component  Cost  Analysis)  now  takes  place. 

The  second  program  selected,  the  C-17,  was  also  chosen  primarily  due  to  the 
extensive  amount  of  cost  estimating  documentation  available.  Additionally,  since  the  first 
case  was  to  involve  the  AFCAA,  it  was  logical  for  another  case  to  include  ASC  to  provide 
adequate  diversity  in  the  estimating  environments.  Moreover,  one  of  the  authors  of  this 
research  effort  had  cost  estimating  experience  in  the  C-17  SPO,  thereby  providing  an 
opportunity  to  inject  case  realism  into  the  scenario  based  on  first-hand  experience. 
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TABLE  5 

Summary  of  Weapon  System  Program  Analysis 


F-22 

Data  classified 

HMD 

ASC 

Aircraft 

LANTERN 

Data  extensive  and 
available  in  cost  library 
and  local  SPO 

O&S 

ASC 

Electronic  warfare 

Initiated  in  1970s 
On-going 

B-IB 

Limited  data 

O&S 

ASC 

Aircraft 

Initiated  in  1980s 

On-going 

C-17 

Data  extensive  and 
available  in  cost  library 
and  local  SPO 

I’roduction 

ASC  and  AFCAA 
Aircraft 

Initiated  in  1981 
On-going 

B-2 

Data  classified 

ftoduction 

ASC  and  AFCAA 
Aircraft 

F-16 

Limited  data 

O&S 

ASC 

Aircraft 

HQgjQQB 

F-15 

Limited  data 

O&S 

ASC 

Aircraft 

ACM 

Limited  data 

O&S 

ASC 

Missile 

Initiated  m  1980s 
Canceled 

SBWAS 

Data  extensive  and 
available  at  SMC  SPO 

DEMA/AL 

SMC 

Satellite 

Initiated  in  1980s 
Canceled  in  1990 

Finally,  the  SBWAS  program  was  chosen  due  to  its  ability  to  offer  a  third  unique 
estimating  environment— space  system  cost  estimating.  Additionally,  Captain  Tracht  had 
previous  experience  with  this  specific  estimate  and  was  available  to  provide  insight  as 
needed  to  aid  in  the  development  of  this  case.  It  should  also  be  noted  that  the  three 
programs  selected  all  represent  different  weapon  systems-electronic  warfare,  aircraft,  and 
satellite,  respectively— thus  providing  highly  diverse  estimating  environments  for  the 
students. 


Case  Writing  and  Implementation 

This  phase  of  the  analysis  involved  developing  teaching  plans,  narrative  cases,  and 
solutions.  Additionally,  each  case  was  analyzed  based  on  criteria  described  in  chapter  HI 
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to  measure  the  overall  effectiveness  of  the  case:  clarity,  realism,  difficulty,  and  student 
learning.  Provided  below  is  a  summary  of  this  analysis  for  each  case.  Specifically,  the  title 
of  each  case  is  presented,  followed  by:  the  case  teaching  plan,  case  clarity  analysis,  case 
reaUsm  analysis,  case  difficulty  analysis,  and  student  learning  assessment.  The  learning 
objectives  for  each  case  can  be  traced  back  to  the  description  of  objectives  presented  in 
Table  4  by  noting  the  objective  numbers  presented  in  parentheses  at  the  beginning  of  each 
teaching  plan. 

As  described  previously,  case  clarity  was  evaluated  based  on  feedback  from  two 
students  who  were  asked  to  review  each  case  (different  students  were  selected  for  each 
case).  The  results  of  the  analysis  of  case  clarity  is  summarized  in  tables  6, 9  and  12. 

Case  realism  was  evaluated  based  on  feedback  from  the  various  cost  organizations 
surveyed  (SMC,  ASC,  ESC,  AFMC,  and  AFCAA).  The  results  of  this  analysis  is 
presented  in  the  form  of  a  descriptive  meta-matrix  for  each  case.  The  first  column  in  each 
meta-matrix,  titled  realism,  identifies  the  impression  each  organization  communicated  in 
the  questionnaire  concerning  the  overall  realism  of  the  case.  The  remaining  columns  in 
each  meta-matiix  refer  to  specific  areas  addressed  in  the  questionnaire.  Note  that 
feedback  suggesting  no  changes  be  made  was  not  included  in  this  sununary.  Only  those 
comments  necessitating  changes  or  that  confirmed  that  the  objective  of  realism  was  met 
were  included.  Case  realism  is  summarized  in  the  meta-matrices  presented  in  Tables  7, 10, 
and  13. 

Case  difficulty  was  analyzed  using  the  student  feedback  questionnaires  and 
comparing  the  students'  perception  versus  the  authors'  forecasted  rating  of  difficulty. 

There  were  two  quantitative  measures  used  to  indicate  case  difficulty-time  expended  and 
student  perception  of  case  complexity.  If  the  student  spent  an  extreme  amount  of  time  on 
a  case  it  could  indicate  that  the  case  was  too  difficult  for  that  particular  student.  On  the 
other  hand,  if  the  person  took  only  a  few  hours  on  a  case  this  might  indicate  the  case  was 
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too  simple.  The  student's  time  spent  was  checked  against  the  student's  solution  to 
determine  if  the  student  knew  what  they  were  doing  or  if  the  student  exerted  little  effort  in 
performing  the  case.  The  second  measure,  student  perception  of  complexity,  was 
evaluated  by  specifically  asking  the  students  to  rank  case  complexity  on  a  scale  from  1  to 
5.  The  ratings  were  as  follows:  1-  not  complex,  2-  slightly  complex,  3-  reasonably 
complex,  4-  considerably  complex  and  5-  extremely  complex.  Figures  2, 3,  and  4 
.summarize  the  time  students  spent  working  on  the  cases. 

Student  learning  was  assessed  by  analyzing  the  solutions  prepared  by  the  students 
in  the  GCA  seminar  class.  This  evaluation  focused  on  three  areas:  methodology, 
accuracy,  and  documentation.  Again,  summary  tables  (Tables  8, 1 1  and  14)  were  used  to 
present  the  overall  assessment  of  student  learning. 

LANURN  Case.  Data  for  this  case  was  extracted  from  a  1981  analogous 
estimate  prepared  by  The  Analytical  Sciences  Corporation  (TASC)  (22).  A  copy  of  the 
LANTIRN  case  is  provided  in  Appendix  1.  Solutions  are  controlled  by  the  GCA  program 
manager. 

Teaching  Plan.  Provided  below  is  the  teaching  plan  for  the  LANTIRN  case. 

I.  Learning  Objectives  (objectives  number:  9,  3,1,2, 1): 

This  case  introduces  the  student  to  the  cost  estimating  environment  in  the  Engineering 
and  Manufacturing  Development  (EMD)  phase.  The  student  will  estimate  the  EMD  and 
Production  portions  of  a  Life  Cycle  Cost  (LCC)  estimate. 

A.  The  student  should  develop  an  appreciation  for  the  Air  Force  Cost  Analysis 
Agency  estimating  environment. 

B.  The  student  should  apply  the  analogy  method  in  developing  a  cost  estimate. 

1.  The  student  will  have  to  justify  the  selection  of  an  appropriate  analogy. 

C.  The  student  should  be  able  to  apply  techniques  to  normalize  data  for 
differences  in  complexity  and  price  levels. 
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1.  The  student  should  understand  how  complexity  factors  are  derived. 

2.  The  student  should  be  able  to  apply  complexity  factors  to  the  analogous 

system. 

3.  The  student  should  understand  the  difference  between  Base  Year  (BY$), 
Then  Year  (TY$),  and  Current  Year  (CY$)  dollars,  and  be  able  to  use  given  inflation 
indices  to  inflate  and  deflate  the  data. 

D.  The  student  should  be  able  to  apply  cost  improvement  curves  to  calculate  Tls, 
slopes,  and  estimate  future  lots. 

E.  The  student  should  understand  the  purpose  of  the  Work  Breakdown  Structure. 

F.  The  student  should  be  able  to  prepare  abbreviated  cost  estimate  documentation. 

G.  The  student  should  be  able  to  create  an  automated  spreadsheet  package  to 
construct  a  weapon  system  summary  (AF  Form  1537)  in  Base  Year,  Then  Year,  and 
Current  Year  dollars. 

n.  Student  Effort 

A.  Estimated  time  out  of  class:  8-10  hours. 

B.  Resources  Available  to  Student:  LEARN,  Spreadsheets  (QPRO,  EXCEL). 

C.  Group  Organization:  Cases  are  designed  for  groups  of  two. 
m.  Teaching  Suggestions 

A.  Subjects  that  should  be  addressed,  along  with  proposed  times  and  possible 
sources  of  information  are  listed  below. 

1.  Discuss  Air  Force  Materiel  Command  (AFMC)  structure  -  the  various  jobs, 
product  centers,  logistic  centers,  and  the  Cost  Analysis  Agency. 

-  Include  a  discussion  of  the  overall  CCA  process  and  the  timing  associated 
with  their  completion. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

45  Min 

Cost  Analysis  Agency  and  AFMC  Handouts 

Suggestion  -  invite  a  guest  speaker  from  the  AFMC/FM  staff  to  speak  to  the  class  on  the 
new  AFMC/FM  structure 
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2.  Show  examples  of  WBSs  and  how  they  are  built. 

-  Show  how  WBS  elements  add  up  to  the  total  weapon  system  cost. 

-  Explain  the  difference  between  Contractor  Furnished  Equipment  and 
Government  Furnished  Equipment,  and  their  impact  on  the  estimate. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

15  Min 

Examples  from  different  Product  Centers 

3. 

Demonstrate  an  abbreviated  format  for  documentation. 

SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

15  Min 

Examples  from  different  estimates 

4.  Discuss  the  use  of  analogous  methods.  Discuss  the  possible  criteria  for 
choosing  one  program  over  another  (judgment,  prior  contractor,  technology,  and  weapon 
system  specifications).  Show  examples  of  the  following: 

-  Choosing  one  program  over  another  program. 

-  Averaging  two  analogous  programs  for  one  estimate. 

-  Taking  a  percentage  of  two  different  analogies  (60%/40%). 

-  Discuss  the  usefulness  of  analogous  estimating  in  the  various  acquisition 

phases. 

-  Demonstrate  an  analogous  estimating  process. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

2 

1.5  Hours 

AFSC  Cost  Handbook,  Blue  Book  documentation,  QMT 
550/551  classes. 

5.  Teach  normalization  techniques  including: 

-  What  are  complexity  factors. 

-  Examples  of  different  complexity  factors  (engineering,  manufacturing). 

-  How  complexity  factors  are  used. 

-  Inflation  rates  and  the  difference  between  BY$ ,  TY$,  CY$;  plus  the 
different  colors  of  money  and  how  they  correspond  to  the  different  life  cycle  phases. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

3 

1.5  Hours 

QMT  175,  AFSC  Cost  Handbook 

6.  Review  Cost  Improvement  Curves  and  explain  how  to  use  the  LEARN 

program. 

-  Emphasize  calculating  T1  and  slopes  from  a  given  data  set. 

-  Demonstrate  how  to  calculate  future  lots. 
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-  Discuss  the  different  learning  curve  programs  available  (ICPRO, 

LEARN). 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

4 

1.5  Hours 

OMT  180,  LEARN  Manual 

Case  Clarity.  As  described  previously,  case  clarity  was  evaluated  based  on 
feedback  from  two  students  in  the  GCA  curriculum  who  were  asked  to  review  the  case. 
Table  6  summarizes  the  feedback  from  the  students. 


TABLE  6 

Summary  of  LANTIRN  Case  Clarity 


1  TP 

STUDENT! 

Clear 

Target  designator 
definition  unclear 

Clear 

Analogous  system 
buy  schedule  unclear 

Liked  analogous 
estimate  flow  chart 

STUDENT! 

Informative 

Clear 

Clear 

Unclear  on 
difference  between 
non-recurring  and 
recurring  costs 

Clear 

Based  on  the  above  feedback,  changes  were  made  to  the  text  of  the  case  or  to  the 
student  teaching  plan  to  clarify  those  areas  that  were  previously  unclear  to  the  students. 

Case  Realism.  It  should  be  noted  that  ESC  did  not  submit  feedback  on  the 
LANTIRN  case.  Table  7  is  a  descriptive  meta-matrix  that  sununarizes  the  feedback  from 
the  various  organizations. 


36 


Table? 

Summary  of  LANTIRN  Case  Realism 


i  •  1 

!^rrrTr''’.'r:'T'"y» 

HIGH 

ASC 

MODERATE 

AFMC 

AFCAA 

LOW 

SMC 

-CCA 
suspense 
uniealistically 
short  (2) 

-CCA 
suspense 
realistic 
-Scenario 
realistic  (2) 
-SAF/FMC 
directs  CCA, 
nolPEO 

-Good  (2) 

-Stare  that 
factors  and 
learning 
curves  were 
validated 

-Good  (2) 

-Spedly 
learning  curve 
program  to 
use 

-  Address  data 
collection  (2) 

-Show  how 
compkxity  tetors 
ate  developed 

-  Flow  chat  good 

-  Good  materials 

Comments  occurring  more  than  once  have  numbers  appended. 


The  following  changes  were  made  to  the  LANTIRN  case  based  on  the  realism 
questiormaire: 


1)  CCA  initiation  changed  to  be  directed  by  SAF/FMC. 

2)  Added  ground  rule  stating  that  factors  and  learning  curves  were  validated  by  an 
independent  technical  assessment  team. 

3)  Added  ground  rule  specifying  particular  learning  curve  program. 

4)  An  explanation  of  the  overall  CCA  process  and  associated  timing  was  added  to 
the  teaching  plan. 

Case  Difficulty.  The  LANTIRN  case  was  assessed  by  the  authors  to  be  reasonably 
complex.  The  amount  of  time  to  be  spent  by  the  students  was  estimated  to  be  8-10  hours. 
Note  that  1 1  (out  of  15)  students  responded  to  the  questionnaire.  The  hours  spent  by  the 
students  is  shown  in  Figure  2.  The  median  score  for  the  LANTIRN  case  is  seven  hours. 
The  hours  spent  fell  below  the  range  of  what  was  expected.  However,  the  range  of  time 
spent  was  from  5-12  hours,  indicating  some  students  had  few  problems  with  the  case 
while  others  may  have  had  much  more  difficulty.  The  student's  perceived  the  case  to  be 
reasonably  complex 


37 


— r  I  I - 1 - 1 - T  1 - 1 - 1 - T - 1 - 1 - 

I  2  3  4  S  6  7  10  11  12  13  M  15 

•  olMeun 


nGUR£2 

_ LANTIRN  Student  Hours  Expended _ 

which  fell  right  in  line  with  the  authors'  expectations.  The  range  of  complexity  varied 
from  1  to  5,  which  corresponds  with  the  range  of  hours  spent  on  the  case.  The  student 
who  took  only  five  hours  also  ranked  the  case  not  complex.  The  LANTIRN  case  can  be 


made  more  difficult  by  removing  the  flowchart  for  the  analogy  process  from  the  content  of 
the  case.  This  step-by-step  chart  takes  the  student  through  the  entire  analogy  estimate. 

By  removing  the  process  flowchart  the  student  must  decide  on  their  own  how  an  analogy 
estimate  is  built.  The  problem  with  deterring  the  right  amount  of  difficulty  needed  in  a 
case  is  not  knowing  what  type  of  students  will  be  involved.  If  the  whole  class  has 
estimating  experience  this  case  may  be  too  simple  and  an  adjustment  (as  mentioned  above) 
to  the  case  may  be  needed. 

Student  Learning.  Table  8  summarizes  how  the  students  performed  in  each  of  the 
areas  evaluated  for  the  LANTIRN  case. 
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TABLES 

Summary  ot  LANTIRN  Case  Student  Learning 


estimate  (S) 

-  Chose  Sharpshooter  for  analogy 
estimate  (I) 

-  Chose  to  average  (equal 
weighting)  PAVE  TACK  and 
Shaipshooter  for  analogy  estimate 
(1) 

-  Used  a  %  factor  against  the  EMD 
dollar  for  underestimating  due  to 
use  of  weighted  least  squares  -  the 
%  amount  is  questionable  ( 1 ) 

-  Derived  complexity  factors 
correctly  (S) 

•  Properly  normalized  data  (7) 

-  Misapplied  learning  curve 
theory(l) 

•  Used  a  step-down  in  learning 
curve,  but  did  not  justify  (1) 

-Did  not  properly  weight  complexity 
factors  (2) _ 


(1) 

-  Computational  errors  on  IS37s  (2) 

-  Error  Free  (3) 


-  Choppy  documentation  ( 1 ) 

-  Non  replicable  estimate  (2) 

-  Good  documentation,  replicable 
estimate  (4) 

-  Did  not  sum  total  cost  element  (1) 


There  were  no  major  problems  with  the  student  solutions,  suggesting  that  the  students 
obtained  a  reasonable  understanding  of  the  estimating  concepts  introduced  in  the  case. 

C-17  CASE.  Data  for  this  case  was  extracted  from  the  1986  C-17  program  office 
Bluebook  documentation  (23)  and  the  1988  C-17  Independent  Cost  Analysis  (24).  A 
copy  of  the  C-17  case  is  provided  in  Appendix  J.  Solutions  are  controlled  by  the  GCA 
program  manager. 

Teaching  Plan.  Provided  below  is  the  teaching  plan  developed  for  the  C-17  case. 

I.  Learning  Objectives  (Objectives  number  5, 6,  3, 2,  17, 1, 14): 
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This  case  introduces  the  student  to  the  cost  estimating  environment  in  the  Production 
phase.  The  student  will  estimate  the  EMD  and  Production  portions  of  a  Life  Cycle  Cost 
(LCC)  estimate. 

A.  The  student  will  develop  an  appreciation  for  cost  estimating  in  the  System 
Program  Office  (SPO)  environment. 

B.  The  student  should  be  able  to  comprehend  Cost  Performance  Reports  and 
perform  associated  calculations. 

1.  The  student  will  have  to  calculate  the  general  measures  of  Estimate  at 
Complete  (EAC),  Cost  and  Schedule  Performance  Indices,  and  percent  complete. 

2.  The  student  should  be  able  to  apply  fiscal  year  spread  (percentages)  to  their 
calculated  EAC  to  develop  an  EMD  hours  estimate. 

3.  The  student  will  be  able  to  use  cost  improvement  curves  to  ^ply  the  EMD 
T1  (based  on  the  above  EAC)  to  their  production  estimate. 

C.  The  student  should  apply  an  appropriate  methodology  to  perform  a  cross¬ 
check  of  their  EAC  estimate. 

D.  The  student  will  understand  when  and  how  to  apply  cost  improvement  curves 
with  a  rate  adjustment. 

1.  The  student  will  understand  the  different  parameters  involved  in  the 
Learning  with  rate  formulation,  and  know  when  it  should  be  applied. 

2.  The  student  will  understand  how  the  Tls  and  slopes  are  affected  by  the 
quantity  rate  adjustment. 

E.  The  student  will  apply  wrap  rates  to  "hour"  estimates. 

F.  The  student  should  be  able  to  prepare  abbreviated  cost  estimate  documentation 
to  support  their  estimating  effort. 

G.  The  student  should  be  able  to  orally  defend  a  cost  estimate  in  a  simulated 
milestone  review. 

n.  Student  Effort 

A.  Time  out  of  class:  13-15  hours. 
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B.  Resources  Available  to  Student:  LEARN,  Spreadsheets  (QPRO,  EXCEL). 

C.  Group  Organization:  Cases  are  designed  for  groups  of  two. 


m.  Teaching  Suggestions 

A.  Subjects  that  should  be  addressed,  along  with  proposed  times  and  possible 
sources  of  information  are  listed  below. 

1.  Discuss  the  SPO  structure  and  how  the  Program  Control  Office  fits  in.  Also 
discuss  the  different  activities  involved  in  a  Program  Control  Shop. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

20  Min 

AFSC  Cost  Handbook  and  Info  from  SPOs 

2.  Briefly  review  the  Basic  C/SCSC  calculations.  Furthermore,  teach  the 
students  how  to  read  and  interpret  Cost  Performance  Reports. 

•  Show  examples  of  Report  22s  and  42s. 


SESSION 

TIME 

SOURCE  OF  INFORMA’nON 

1 

30  Min 

SYS  362/363,  AFSC  Cost  Handbook,  Examples  from 
SPOs 

3.  Teach  students  the  milestone  briefing  review  process  (who  the  major 
players  are,  the  cost  estimator's  role,  and  the  various  review  boards). 

-  Address  the  major  elements  that  should  go  into  a  milestone  briefing. 


SESSION 

TIME 

SOURCE  OF  INFORMA'nON 

1 

AFSC  cost  handbook 

4.  Teach  the  concepts  of  learning  curve  with  the  rate  adjustment. 

-  Teach  the  theory  and  basic  calculations. 

-  Discuss  how  learning  with  the  rate  adjustment  can  be  incorporated  into  an 
electronic  spreadsheet. 


SESSION 

TIME 

SOURCE  OF  INFORMA'nON 

2&3 

3Hrs 

Articles,  C-17  case  rate  application  guidance 

5.  Discuss  the  different  approaches  to  cross-checks  and  show  examples  fiom 
cost  estimates. 
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SESSION 

TIME 

SOURCE  OF  INFORMATION 

4 

1  Hr 

Examples  from  estimates  (F-22) 

6.  Teach  the  construction  of  wrap  rates. 

-  Define  the  elements  that  make  up  wrap  rates  (Indirect/Direct  labor,  profit, 
G&A,  FPRA...) 

-  Demonstrate  how  rates  are  applied  to  hour  estimates. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

5 

1.5  Hours 

Example  rate  proposals,  AFSC  Cost  Handbook 

Suggestion:  Have  guest  speaker  who  has  constructed  wrap  rates  speak  to  class. 


Case  Clarity.  Table  9  presents  the  result  of  the  clarity  analysis  for  the  C-17  case. 
Note  that  ground  rules  were  not  separately  listed  in  this  case— rather  they  were  embedded 
in  the  case  narrative.  Thus  ground  rules  were  not  included  in  any  of  the  feedback 
evaluations  of  this  case. 


TABLE  9 

Summary  of  C>17  Case  Clarity 


STUDENT  1 

Very  good, 
realistic 

Clear 

Unclear  on 
cross-check 

Clear 

STUDENT2 

Clear 

Clear 

Clear 

Unclear  on  cross¬ 
check 

Case  Realism.  Feedback  on  this  case  was  not  submitted  by  SMC.  Table  10 
summarizes  the  results  of  the  realism  analysis. 
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TABLE  10 

Summary  of  C-17  Case  Realism 


... 

X..-,..:  ■  .  -v-  v,.  1. 

HIGH 

AFMC 

ASC 

MODERATE 

ESC 

APCAA 

-  Realistic  (3) 

-  Excellent  overall 
case  (2) 

-  Realistic 
-Need  better 
discussion  of  rale 
theory 

-  Specify  whether  the 
EAC  formula  should 
be  cumulative 

-V«y  good 

-  Data  coUection 
oversimplified 

-  Need  to  verify 
manufacturing  data 

-Good 

*  Comments  occurring  more  than  once  have  numbers  appended. 


The  following  changes  were  made  to  the  C-17  case  based  on  the  realism  feedback: 

1)  Rate  theory  was  revised  to  reflect  more  accurate  discussion  of  theory. 

2)  The  EAC  formula  was  specified  as  cumulative. 

3)  The  C-17  narrative  was  clarified  to  provide  a  more  accurate  discussion  of  rate 
theory  in  cost  improvement  curve  applications. 

4)  A  statement  was  added  to  the  narrative  stating  that  the  C-17  manufacturing 
hours  were  developed  and  validated  by  another  analyst. 

Case  Difficulty.  The  C-17  case  was  evaluated  by  the  authors  to  be  considerably 
complex.  The  amount  of  time  to  be  spent  by  the  students  was  estimated  to  be  13-15 
hours.  Note  that  only  ten  (out  of  15)  students  responded  to  the  questionnaire.  The 
distribution  of  expended  student  time  on  the  C-17  case  is  provided  in  Figure  3.  The  hours 
spent  fell  at  the  top  of  the  range  of  what  was  expected.  The  range  of  responses  was  from 
10-18  hours,  indicating  that  for  the  majority  of  students  with  no  cost  estimating 
experience  some  additional  instructional  guidance  may  be  needed.  The  median  complexity 
rating  {considerably  complex)  mirrored  the  hours  spent  by  the  students  and  the  Jiors' 
expectations.  The  range  of  complexity  varied  from  3-5. 
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•  of  Hour 


nGUR£3 

C-17  Student  Hours  Expended 


Student  Learning.  Table  1 1  summarizes  the  student  learning  analysis  for  this  case. 


TABLE  11 

Summary  of  C*17  Case  Student  Learning 


BMP 

-  performed  correctly  (7) 
PRODUCTION 

-  performed  correctly  (5) 

-  misapplied  learning  (2) 
CROSSCHECK 

-  logically  developed  (7) 

-  Underestimated  EMD  (2) 

-  Overestimated  production  (2) 

-  Replicable  documentation  (7) 

There  were  no  major  problems  with  the  student  solutions.  In  fact,  several  of  the  students 


presented  innovative  cross-check  methodologies  in  their  documentation  and  estimate 
briefing.  The  considerable  difficulty  students  encountered  in  conducting  this  case  was 
not  reflected  in  the  solutions  they  presented.  Perhaps  their  extensive  effort  (demonstrated 
by  the  significant  hours  spent  on  the  case)  overcame  any  initial  problems  they  had  with  the 
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case  concepts.  In  any  event,  the  solutions  demonstrated  an  understanding  of  the  learning 
objectives. 


SBWAS  Case.  Data  for  this  case  was  extracted  from  the  1988  SBWAS  program 
office  Bluebook  documentation  (25).  A  copy  of  the  SBWAS  case  is  provided  in 
Appendix  K.  Solutions  are  controlled  by  the  GCA  program  manager. 

Teaching  Plan.  The  teaching  plan  for  this  case  is  provided  below. 

I.  Learning  Objectives  (Objectives  number  7, 4,  8,  3,  1, 2): 


This  case  introduces  the  student  to  cost  estimating  in  the  Concept  Exploration  phase. 
The  student  will  estimate  the  RDT&E  and  Production  portions  of  a  Life  Cycle  Cost 
(LCC)  estimate. 

A.  The  student  will  develop  an  appreciation  for  cost  estimating  as  a  staff  cost 
analyst  at  the  Space  &  Missile  Systems  Center. 

B.  The  student  will  apply  the  Automated  Cost  Estimating  Integrated  Tools  (ACE- 
rr)  software  program  to  perform  the  following  tasks: 

1.  Build  a  Work  Breakdown  Structure. 

2.  Select  and  execute  appropriate  CER  based  methodologies. 

3.  Incorporate  fee,  G&A,  and  overhead  in  a  cost  estimate. 

4.  Perform  sensitivity  analysis  of  changes  to  various  system  parameters. 

5.  Time-phase  an  estimate  using  an  appropriate  phasing  technique  (Beta, 
man-hour  spread  etc.,). 

6.  Develop  appropriate  cost  estimate  documentation 

C.  The  student  should  be  able  to  develop  a  demonstration/validation  cost 
estimate  given  various  throughputs  (technology,  contract  costs,  mission  support,  etc.,). 


n.  Student  Effort 

A.  Time  out  of  class:  10-12  hours. 
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B.  Resources  Available  to  Student:  ACE-IT  Program,  Spreadsheets  (QPRO, 
EXCEL). 

C.  Group  Organization:  Cases  are  designed  for  groups  of  two. 
in.  Teaching  Suggestions 

A.  Subjects  that  should  be  addressed,  along  with  proposed  times  and  possible 
sources  of  information  are  listed  below. 

1 .  Discuss  the  structure  of  the  Cost  Directorate  in  the  Space  and  Missile 
Systems  Center  (SMC). 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

15  Min 

Dave  Hansen  slides,  LA  POCs 

2.  Review  various  time-phasing  techniques. 

-  Include  Beta  phasing  and  mahout  spreads. 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

30  Min 

AFSC  Handbook 

3. 

Explain  the  use  of  multiplicative  correction  factors  (bias  reduction  factors). 

SESSION 

TIME 

SOURCE  OF  INFORMATION 

1 

30  Min 

Danneman  article  and  other  readings 

3.  Teach  the  students  how  to  use  ACE-IT  and  discuss  its  various  functions. 

-  In  a  classroom  setting  discuss  the  purpose/background  of  ACE-IT 

-  In  a  computer  lab  demonstrate  the  basic  functions  of  ACE-IT. 

-  Specifically  address  the  use  of  "what-if '  analyses. 

-  Include  a  discussion  of  other  automated  cost  estimating  software  (  such 
as  the  ASC  cost  workstation). 


SESSION 

TIME 

SOURCE  OF  INFORMATION 

2-5 

6Hrs 

Tecolote  representative 

4. 

Expose  the  student  to  various  styles  of  cost  estimate  documentation. 

SESSION 

TIME 

SOURCE  OF  INFORMATION 

6 

45  min 

Examples  from  bluebooks 
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Case  Clarity.  Table  12  summarizes  the  results  of  the  clarity  analysis  for  this  case. 


TABLE  12 

Summary  of  SBWAS  Case  Clarity 


1 0  '  ^ 

■•s  '  '••V.  ■'  s 

. 

'  ^  Ns 

i  "ss  V.'  S  '• 

STUDENTl 

Clear 

Very  good 

Unclear  on  ACEIT 

STUDENT 2 

Good 

Include  overall 

WBS 

Clarify  extent  of 
documentation 

Clarify  beta  curves 

Unclear  on  ACEIT 

Changes  were  made  to  the  narrative  of  this  case  or  the  teaching  plan  based  on  the  above 
comments.  For  example,  the  case  tasking  was  modified  to  specify  that  only  appropriate 
documentation  should  be  provided.  In  other  words,  students  should  not  submit  all  of  the 
documentation  possible  using  ACEIT,  only  that  portion  which  adequately  presents  the 
results  of  the  estimating  effort. 


Case  Realism.  Note  that  feedback  on  this  case  was  not  provided  by  SMC.  The 
descriptive  meta-matrix  presented  in  Table  13  sununarizes  the  results  of  the  realism 
analysis. 


TABLE  13 

Summary  of  SBWAS  Case  Realism 


' <  .<  -y  >■  ■:<  • .  :  :  '•  X  y.  s':  ^  SXX:- *  n 

\ss ''  ''X  -Xs  <:s  sv  'n  '  '^s  --'X  ^ 

5  X  <  s  '^>0)  ' 

HIGH 

AFMC 

ASC 

MODERATE 

ESC 

AFCAA 

-  Very  good  (2) 

-  Explain  that 
numerous 
concepts  can  be 
expk)^ 

-  Excellent 

case 

-Good  section 

•Good 
•State  that 
learning  curves 
were  validated 
•Add  contract 
estimate  to  this 
section 

-Show  where  the 

5%  ECO  came 
from 

-Introduce 

ASC  cost 
workstatioa  (2) 
-Clarify 
documentation 
required 
-  Discuss  model 
verification  (2) 

-Include 
discussionof 
ACEIT  model 
-WBS  not 
compliant  with 
regulations  (3) 

*  Comments  occurring  more  than  once  have  numbers  appended. 
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The  following  changes  were  made  to  the  SBWAS  case  based  on  the  feedback. 

1)  A  ground  rule  spediying  that  the  two  DEMA^AL  contractor  estimates  are 
judged  to  be  equal  in  effort  was  added. 

2)  The  scenario  was  revised  to  reflect  that  numerous  concepts  were  still  under 
exploration,  but  only  one  was  to  be  considered  in  this  analysis. 

3)  A  discussion  of  other  automated  cost  estimating  software  (such  as  the  ASC 
cost  workstation)  was  added  to  the  teaching  plan. 

Case  DiflScultv.  The  SBWAS  case  was  evaluated  by  the  author's  to  be 
reasonably  complex.  The  median  amount  of  time  to  be  spent  by  the  students  was 
forecasted  to  be  10-12  hours.  Note  that  only  seven  (out  of  15)  students  responded  to  the 
questionnaire.  Figure  4  shows  the  student  time  expended  for  the  SBWAS  case. 


The  median  hours  (8)  spent  fell  below  the  forecasted  range  of  the  authors.  The  range  of 
time  was  from  6-12  hours.  At  first  glance  the  hours  indicate  very  few  students  had 
problems  with  the  case  and  probably  thought  the  case  was  simple.  However,  the  solution 
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turned  in  by  most  students  was  of  poor  quality  (the  specific  analysis  of  student  learning 
will  be  covered  in  the  next  section).  It  was  difBcult  to  assess  the  difficulty  solely  on  the 
hours  ^>ent  due  to  the  apparent  lack  of  studoit  effort.  On  the  other  hand,  the  overall 
complexity  was  right  in  line  with  the  author’s  expectations.  The  range  of  compledty 
varied  fi'om  2-4.  Most  students  perceived  the  case  to  be  reasonably  complex.  However, 
after  looking  at  the  solutions  it  appeared  that  many  of  the  students  still  do  not  understand 
how  to  use  ACE-IT.  Learning  to  use  the  ACE-IT  program  appeared  to  be  an  easy  task, 
but  many  of  the  inexperienced  analysts  mis-applied  ACE-IT,  and  did  not  realize  there 
mistakes  because  of  their  lack  of  understanding  of  electronic  spreadsheets.  Most  of  the 
difficulty  in  this  case  can  be  traced  to  students'  inability  to  use  ACE-IT  properly;  therefore, 
a  good  training  session  for  the  students  is  needed  for  the  case  to  be  reasonably  difficult. 

Student  Learning.  Table  14  summarizes  the  student  learning  evaluation. 


TABLE  14 

Summary  of  SBWAS  Case  Student  Learning 


PENVVAl 

-  perfonned  correctly  (4) 

-  {biased  wrong  (2) 

-  Left  out  one  contractor 
EMD 

-  performed  cmrectly  (6) 

-  misinterpreted  CER  units 
PRODUCTION 

-  performed  correctly  (6) 

-  summary  costs  omitted 


■  Overestimated  EMD  (3) 

•  Overestimated  DEM/VAL  (2) 

■  Underestimated  DEM/VAL  (2) 


-  Replicable  documentation  (3) 

-  Summary  costs  omitted  (3) 

-  Poorly  organized  (4) 


Many  of  the  methodologies  utilized  by  the  students  were  not  lo^cally  developed  or 
justified.  The  primary  reason  for  the  student  problems  with  this  case  was  their  lack  of 
understanding  of  the  ACEIT  software  used  to  conduct  the  estimate.  Specifically,  many 
students  misinterpreted  the  cost  estimating  relationships  (CERs)  embedded  in  the 
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software.  Additionally,  few  of  the  students  were  able  to  properly  organize  the  ACEIT 
documentation  output.  Students  require  more  exposure  to  ACEIT  training  to  overcome 
these  problems. 
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Concliisioiis 


V.  Conclusions  and  Recommendations 


The  goal  of  this  research  effort  was  to  develop  cases  that  would  bridge  the  gap 
between  the  theory  and  priciples  of  cost  estimating  currently  taught  in  the  AFTT 
curriculum  and  the  real  world  of  cost  estimating  in  the  acquisition  arena.  To  accomplish 
this  effort  four  research  objectives  were  investigtUed.  The  first  three  research  objectives 
presented  in  this  study  basically  served  to  set  the  stage  for  the  fourth  and  final  objective: 
provide  cases  based  on  realistic  scenarios  that  will  facilitate  student  learning  of  important 
cost  estimating  skills.  In  other  words,  the  first  three  objectives  provided  the  inputs 
required  to  carry  out  the  fourth  objective.  Chiq>ter  IV  presented  the  results  of  the  analysis 
of  each  of  these  objectives.  However,  it  is  objective  four  that  comprised  the  bulk  of  this 
research  effort,  and  fittingly  the  success  of  the  overaU  research  effort  can  be  accurately 
gauged  through  an  analysis  of  objective  four's  results. 

Recall  that  objective  four  was  analyzed  based  on  four  criteria:  clarity,  realism, 
difficulty,  and  student  learning.  Questioimaires  were  used  to  collect  data  in  order  to 
analyze  the  first  three  criteria.  While  the  majority  of  the  responses  demonstrated  the  cases 
met  the  above  criteria,  only  by  incorporating  the  feedback  from  these  questionnaires  into 
the  narrative  cases  and/or  teaching  plans  could  attainment  of  this  objective  be  assured. 
Based  on  the  results  presented  in  Chapter  IV,  the  authors  are  confident  that  the  three 
cases  presented  in  the  Appendices  are  in  fact  clear,  realistic,  and  of  appropriate  difficulty. 

It  should  be  noted  that  assessing  the  appropriate  level  of  difficulty  of  a  case  is  a 
-subjective  determination  that  must  be  made  in  light  of  the  skill  and  experience  base  of  the 
targeted  students.  The  level  of  difficulty  designed  into  these  cases  was  constructed  to 
meet  the  background  of  the  students  in  the  current  AFTT  GCA  curriculum.  While  it  is 
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probable  that  the  skill  mix  of  future  GCA  students  will  remain  somewhat  consonant  with 
this  baseline,  it  is  still  possible  that  a  future  class  could  have  considerably  more  or  less  cost 
estimating  experience.  The  cases  were  designed  to  accommodate  for  this  through 
instructor  modifications  to  either  the  attachments  provided  in  the  cases,  or  to  the  teaching 
plans.  For  example,  the  LANTIRN  case  was  designed  to  be  the  most  straightforward  case 
developed  (as  substantiated  through  student  feedback).  However,  this  case  can  be  made 
.considerably  more  difficult  simply  by  removing  the  analogy  estimate  flow  chart  given  in 
the  case.  This  would  result  in  students  having  to  make  several  more  decisions  in  their 
analysis.  Additionally,  the  C-17  case  was  designed,  and  through  student  feedback  was 
proven  to  be,  the  most  difficult  case.  The  instructor  can  make  this  case  less  con^ilex  by 
providing  exan^les  of  estimate  cross-checks  and  discussing  the  creativity  involved  with 
their  derivation.  A  significant  driver  of  difficulty  in  the  SBWAS  case  involves  the 
software  the  case  requires  the  student  to  use-Automated  Cost  Estimating  Integrated 
Tools  (ACEIT).  Any  attempt  to  modify  the  difficulty  of  this  case  would  require  changes 
to  the  amount  of  ACEIT  training  made  available  to  the  students. 

The  final  criteria  used  to  measure  the  overall  effectiveness  of  the  cases-student 
leaming~was  analyzed  by  evaluating  the  solutions  to  the  cases  submitted  by  the  students 
in  the  GCA  seminar  class.  Evaluation  of  the  solutions  was  not  based  solely  on  the  final 
numbers  presented,  but  primarily  on  the  soundness  of  the  methodology  employed  by  the 
students.  As  discussed  in  Chapter  IV,  many  unique  solutions  to  the  cases  were  presented 
by  the  students.  The  vast  majority  of  these  solutions  did  in  fact  meet  the  test  of 
reasonableness.  Based  on  the  above  discussion,  the  authors  are  confident  that  the  cases 
introduced  in  the  GCA  seminar  class  did  in  fact  facilitate  student  learning  of  important 
cost  estimating  skills. 
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Recommendatioiis 

The  results  of  this  effort  have  generated  the  following  suggestions  for  further 
research  efforts. 

Recommendation  1.  Additional  cases  should  be  developed  to  further  integrate  the 
case  method  of  instruction  into  the  GCA  curriculum.  All  15  of  the  students  in  the  seminar 
class  communicated  through  the  difficulty  questionnaires  that  the  cases  were  extremely 
helpful  in  solidifying  their  understanding  of  acquisition  cost  estimating.  In  fact,  they  all 
agreed  that  additional  cases  introduced  throughout  the  curriculum  would  be  even  more 
helpful.  Specifically,  cases  should  be  developed  to  address  those  cost  estimating  skills 
identified  by  the  field  questionnaires  but  not  included  in  the  cases  presented  here.  For 
example,  a  case  could  be  developed  to  allow  students  to  prepare  an  operations  and 
support  cost  estimate. 

Recommendation  2.  The  cases  should  be  introduced  earlier  in  the  curriculum  to 
provide  students  with  more  time  to  focus  on  the  cases.  Nearly  all  of  the  students  in  the 
seminar  class  felt  their  thesis  efforts  in  the  final  quarter  detracted  from  their  ability  to  focus 
on  the  cases.  These  students  all  suggested  implementing  the  cases  earlier  in  the 
curriculum,  such  as  in  the  spring  quarter. 

Recommendation  3.  Consider  making  the  cases  individual  efforts  versus  being 
performed  in  groups  of  two.  A  few  of  the  students  related  that  the  case  taskings  were 
sometimes  split-up  between  members  of  a  team,  versus  being  performed  together  as 
designed.  Thus  it  is  possible  that  a  student  may  only  have  been  exposed  to  half  of  the 
learning  objectives  for  a  particular  case.  It  could  be  that  the  workload  of  the  last  quarter 
at  AFTT  (due  to  the  thesis  effort  as  discussed  above)  forced  a  few  of  the  groups  to  divide 
their  taskings.  If  the  cases  are  implemented  in  an  earlier  quarter  next  year,  two  person 
teams  may  still  be  appropriate  as  students  may  not  feel  as  much  time  pressure  to  get 
through  the  cases. 
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Appendix  A: 

Partial  List  of  Cost  Estimating  Terms 
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Definitions  (8iAl-A79) 


Acquiation  Cost:  The  sura  total  of  all  developraent  and  production  costs  for  a 
program.  Acquisition  cost  plus  ownership  cost  equals  total  life  cycle  cost 

Algorithm:  A  set  of  ordered  procedures,  steps,  or  rules  usually  applied  to 
mathematical  procedures  and  assumed  to  lead  to  the  solution  of  a  problem  in  a  finite 
number  of  steps. 

Analogy:  An  estimating  method  that  uses  actual  costs  of  a  similar  existing  or  past 
program  and  adjusts  for  complexity,  technical,  or  physical  differmces  to  derive  new 
system  estimate.  Also  referred  to  as  analog  and  analogous  cost  estimates. 

Analysis:  A  systematic  approach  to  problem  solving.  Complex  problems  are 
simplified  by  separating  them  into  more  understandable  elements. 

Base  Year  Dollars:  Dollars  which  are  expressed  in  the  economic  condition  of  a 
specific  year  and  do  not  include  escalation  or  inflation  for  future  years.  A  base  year  dollar 
reflects  the  "purchasing  power"  of  the  dollar  for  the  specified  base  year. 

Budgeting:  The  process  of  translating  {q)proved  or  negotiated  resource 
requirements  (manpower  and  material)  into  time-phased  financial  targets  or  goals. 

Catalog  Estimating:  An  approach,  also  known  as  handbook  estimating,  involving 
the  use  of  handbooks,  catalogs,  and  other  reference  books  that  are  published  with  price 
lists  for  standard,  off-the-shelf  items. 

Constant  Year  Dollars:  A  phrase  reflecting  the  dollar  "purchasing  power"  for  a 
specified  year.  An  estimate  is  in  constant  dollars  when  prior  years  costs  ate  adjusted  to 
reflect  the  level  of  prices  of  the  base  year,  and  future  costs  are  estimated  without  inflation. 

Contract  Work  Breakdown  Structure  (CWBS):  The  work  breakdown  structure 
that  addresses  only  those  WBS  elements  applicable  to  a  specified  contract 

Cost  Driver:  The  characteristics  of  a  system  or  end  item  that  have  a  large  or  major 


effect  on  the  system's  cost 
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Cost  Estimating  Relationship  (CER):  A  mathematical  expression  relating  cost 
as  the  dependent  variable  to  one  or  more  inttependent  cost  driving  variables.  Hie 
relationship  may  be  cost-to-cost  such  as  using  manufacturing  hours  to  estimate  quality 
assurance  hours  or  using  manufacturing  hours  to  estimate  dollars  for  expendable  material 
such  as  rivets,  primer,  or  sealant  The  relationship  may  also  be  cost-to-noncost  such  as 
estimating  manufacturing  hours  by  the  use  of  weight  or  using  the  number  of  engineering 
drawings  to  estimate  engineering  hours.  Both  weight  and  engineering  drawings  are 
noncost  variables. 

Cost  Improvement  Curve  Theory:  A  theory  that  states  that  the  quantity  of  items 
produced  increases,  costs  decrease  at  a  predictable  rate.  "Unit”  cost  improvement  curve 
theory  describes  the  relationship  between  the  cost  of  individual  units.  "Cumulative 
average"  theory  describes  the  relationship  between  the  average  cost  of  different  quantities 
of  units. 

Cost  Model:  An  estimating  tool  consisting  of  one  or  more  cost  estimating 
relationships,  estimating  methodologies,  or  estimating  techniques  used  to  predict  the  cost 
of  a  system  or  one  of  its  lower  level  elements. 

Cross-Check  Method:  An  estimating  methodology  that  is  different  from  the 
estimating  approach  selected  as  the  primary  method.  It  is  typically  applied  to  those  cost 
elements  that  contribute  heavily  to  the  total  estimate  to  ensure  that  the  primary  method 
employed  has  generated  credible  results. 

Discounting:  A  technique  for  converting  forecasted  amounts  to  economically 
comparable  amounts  at  a  common  point  in  time,  considering  the  time  value  of  money. 

Estimate  At  Completion  (EAC):  The  current  estimate  of  what  the  final  cost  will 
be  for  the  task,  whether  it  be  the  total  contract  or  just  a  portion  therof.  It  consists  of 
actual  costs  t  date  plus  the  estimate  of  the  balance  to  complete  through  contract 
completion. 
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Grass  Roots  Ertimate:  (1)  Prepared  by  contractors  -  an  estimate  developed  by 
requesting  and  collecting  estimates  from  functional  orgaiuzations  within  a  company  or 
agencv  for  a  specific  statnnent  of  work  or  task.  Usually  developed  by  a  combination  of 
nuiny  estimating  methods  and  techniques  but  developed  by  the  "doing"  people.  (2) 
Prepared  by  in-house  Goverrunent  Analysts  -  normally  done  at  a  functional  level  of  detail 
udth  regards  to  labor  with  a  breakout  of  maj(»^  subcontracts  and  material  items  also 
included.  It  is  normally  prepared  to  forecast  out-year  costs  for  systems  in  production  or 
for  which  prototype  production  cost  data  are  available. 

Independent  Cost  Estimates:  An  analysis  of  program  cost  prepared  in  support  of 
the  AFS ARC/DAB  process,  generally  accomplished  on  all  major  weapon  system  programs 
at  Milestone  I,  n,  and  m.  It  is  intended  to  provide  an  independent  "test  of 
reasonableness"  of  the  PCE  and  as  such,  it  is  a  discrete  point  estimate  prepared  by  a  team 
organizatioruilly  separate  from  program  advocacy. 

Inflation:  A  rise  in  the  general  level  of  prices.  Pure  inflation  is  defined  as  a  rise  in 
the  general  level  of  prices  unaccompanied  by  a  rise  in  output  (productivity). 

Mr^or  Weapon  System:  One  of  a  limited  number  of  systems  or  subsystems 
which,  for  reasons  of  military  urgency,  criticalness,  or  resource  requirements,  is 
determined  by  the  DoD  as  being  vital  to  the  national  interest 

Most  Probable  Cost  (MPC):  The  Govenunent's  estimate  for  each  competing 
bidder  in  a  source  selection  environment  MPC  results  are  by  the  source  selection 
authority  in  determining  the  winning  contractor,  and  it  often  becomes  the  only  meaningful 
measure  of  the  realism  of  the  bidders'  cost  proposal 

Normsdized:  (1)  Data  base  -  to  ren^r  constant  or  to  adjust  for  known  differences. 
(2)  Dollars  •  various  fiscal  year  costs  are  inflated/deflated  to  a  common  year  basis  for 
comparison. 
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Operating  and  Support  Costs  (O&S):  The  added  or  variable  costs  of  personnel, 
materials,  facilities,  and  other  items  needed  for  the  peacetime  operation,  maintenance  and 
support  of  a  system  during  activation,  steady  state  operation,  and  disposal. 

Overhead:  (Indirect)  A  cost  which,  because  of  its  incurrence  for  common  or  joint 
objective,  is  not  readily  subject  to  treatment  as  a  direct  cost  Such  indirect  cost  is  incurred 
to  benefit  the  total  direct  cost  or  business  base  of  a  contractor.  Accordingly,  the  overhead 
applicable  to  any  one  estimate  or  contract  is  by  an  appropriate  distribution  of  indirect 
costs  through  the  use  of  a  rate  per  hour  or  percentage  applied  to  direct  hours  or  costs. 

Parametric  Estimating:  An  estimating  technique  which  employs  one  or  more 
cost  estimating  relationships.  It  involves  collecting  relevant  historical  data  at  an 
aggregated  level  of  detail  and  relating  it  to  the  area  to  be  estimated  through  the  use  of 
mathematical  techniques. 

Pit^am  Acquisition  Costs:  The  sum  of  development  and  production  costs. 
Military  construction  costs  may  be  included  if  directly  related  to  the  weapon  system. 

Initial  spares  are  also  included. 

Program  Cost  Estimate  (PCE):  A  program  manager's  official  estimate  of  the 
financial  resources  required  to  competently  conduct  the  program  contained  in  the  Program 
Management  Directive. 

Regression  Analysis:  The  association  of  one  or  more  independent  variables  with  a 
dependent  variable.  Under  static  conditions  the  analysis  is  called  correlation.  When  used 
for  predictive  purposes,  it  is  referred  to  as  regression. 

Sensitivity  Analysis:  Repetition  of  an  analysis  with  different  quantitative  values 
for  selected  parameters  or  assumptions  for  the  purpose  of  comparison  with  the  results  of 
the  basic  analysis.  If  a  small  change  in  the  value  of  the  variable  results  in  a  large  change  in 
the  results,  then  the  results  are  said  to  be  sensitive  to  that  parameter  or  assumption. 
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Statement  of  Work:  A  document  stating  the  confines  of  the  contractual  work  to 
be  accomplished.  The  part  of  an  RFP  or  contract  that  defines  the  work  which  a  customer 


wants  performed. 

Then  Year  Dollars:  Dollars  which  reflect  purchasing  power  at  the  time 
expenditures  are  actually  made.  Sometimes  referred  to  as  escalated  or  inflated  costs. 

Prior  costs  expressed  in  then  year  dollars  are  the  actual  amounts  paid  out  in  these  years. 
Future  costs  stated  in  then  year  dollars  are  projected  actual  amounts  to  be  paid. 

Weapon  System  Cost:  Ryaway  cost  plus  the  elements  of  peculiar  support 
equipment,  data,  and  training,  as  well  as  operational/site  activation  and  industrial  facilities. 
The  only  production  cost  excluded  in  this  calculation  is  that  of  initial  spares. 

Work  Breakdown  Structure  (WBS):  A  method  of  diagramming  the  way  that 
work  is  to  accomplished  by  separating  the  work  content  into  individual  elements. 

Wrap  Rates:  A  total  rate  per  hour  that  covers  direct  labor,  overhead,  fringe 
benefits,  and  other  costs.  Also  may  include  factored  labor  costs,  support  services,  travel, 
and  material  costs. 
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Appendix  B: 

Description  of  Cost  Analyis  Courses  in  GCA  Curriculum 
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Statistics  for  Cost  Analysts.  This  course  is  an  introduction  to  descriptive  and  inferential 
statistics.  The  course  covers  various  measures  of  central  tendency  and  dispersion,  as  well 
as  some  typical  display  techniques.  The  concepts  of  probability  and  nonparametric  tests 
are  covered  in  great  detail. 

Defense  Cost  Modeling.  This  course  focuses  on  the  use  of  regression  analysis  as  a 
methodology  for  developing  cost  models.  Single  and  multiple  predictor  linear  models  are 
analyzed,  followed  by  a  discussion  of  non-linear  models. 

Quantitative  Management  of  Software.  Covers  the  topic  of  software  management  with 
emphasis  on  quantitative  activities  such  as  software  estimation  and  measurement  Other 
issues  addressed  include  the  software  development  process;  software  product  assurance; 
and  software  size,  quality,  and  schedule. 


Model  Diagnostics.  This  course  is  a  continuation  of  Defense  Cost  Modeling.  It  explores 
the  problem  of  developing  cost  models  when  one  or  more  of  the  basic  assumptions  of  the 
regression  model  do  not  hold  true. 


Life  Cycle  Cost  and  Reliability.  Explores  the  concepts  and  methodologies  which  should 
be  considered  in  the  development  or  improvement  of  the  life  cycle  cost  (LCQ  models. 

The  different  types  of  LCC  models  are  defined  and  the  limitations  of  specific  models  in  use 
are  discussed. 


Project  Risk  Analysis.  Introduces  the  concept  of  risk  in  the  acquisition  of  major  weapon 
systems.  The  elements  of  technical,  schedule,  and  cost  estimating  risk  are  discussed,  with 
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a  specific  focus  on  the  different  quantitative  arul  qualitative  methods  of  predicting  cost 
risk. 


Cost  E5Stimfltin^  for  Weannn  System  Production.  Hie  purpose  of  this  course  is  to 
provide  students  with  the  skills  needed  to  analyze  data  provided  by  major  weapon  system 
contractors.  The  manufacturing  and  production  process  is  introduced  to  the  student,  with 
a  focus  on  learning  curve  theory. 

Seminar  in  Cost  Analysis.  Introduces  the  student  to  current  topics  and  issues  of  interest 
to  the  cost  analysis  community.  Integrates  the  material  covered  in  the  curriculum.  This  is 
the  targeted  location  for  implementing  the  cases  developed  in  this  research  effort 
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Appoidix  C: 

Cost  Estimating  Skills  Questionnaire 
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FROM: 


9  Feb  93 


AFIT/LAS  (Major  Simpson) 

SUBJECT:  Case  Studies  to  Support  AFTT  C<»t  Analysis  Curriculum 

TO:  Case  Study  Points-of-Contact 

AFCAA/CC  (Col  Ronald  Daigler) 

AFMC/™C  (Col  Richard  Michaud) 

SMC/I^C  (\b  David- Hansen) 

ASC/FMC  (Mr  R^.  Schwenke) 

ESC/FMC  (Ms  Elian  Coakley) 

1.  Two  members  of  the  current  Graduate  Cost  Analysis  class  are  developing  a  set  of 
student  cases  to  be  used  in  cost  analysis  curricultun  here  at  AFTT.  Capt  Kerrie  Glenn 
and  Capt  Jim  Passaro’s  thesis  effort  is  to  provide  a  set  of  cases  that  will  develop  and  test 
the  AFTT  student’s  abilities  to  apply  the  concepts  taught  in  the  cost  analysis  curriculunL 
To  ensure  that  we  produce  a  relevant  product,  we  invite  you  to  participate  in  the 
preparation  and  review  of  the  cases. 

2.  There  are  three  ways  in  which  you  can  help  us  in  the  case  development.  First,  we 
would  like  your  input  on  the  objectives  that  the  cases  should  seek  to  achieve.  The 
attached  document  is  an  informal  questionnaire  designed  to  solicit  your  input  on  case 
objectives.  Second,  we  ask  you  to  identify  potential  data  somces  that  you  feel  will 
support  the  case  objectives.  We  feel  the  value  of  the  cases  will  increase  if  they 
realistically  reflect  Ae  characteristics  of  the  different  weapon  systems  we  estimate.  To 
the  extent  that  these  cases  can  be  grounded  in  "real-world"  systems  and  "real-world"  data, 
the  better  the  cases  will  prepare  the  student  Finally,  we  ask  you  to  review  the  cases  as 
they  are  drafted.  We  feel  the  quality  of  the  product  can  be  improved  through  a  review 
by  estimators  in  the  field. 

3.  Jim  and  Kerrie  would  like  to  complete  the  cases  in  time  to  test  them  on  the  current 
GCA  class  this  summer.  In  order  to  accomplish  this,  they  will  need  to  have  final  drafts 
by  15  Jun.  To  support  this  schedule,  we  ask  that  you  return  your  inputs  on  case 
objectives  as  soon  as  possible.  If  we  receive  your  inputs  by  28  February,  we  feel  that  we 
have  a  good  chance  of  meeting  our  schedule. 

4.  Thank  you  for  your  time  and  cooperation.  If  you  have  questions,  please  contact  Capt 
Kerrie  Glenn  at  (513)  426-0703  or  Capt  Jim  Passaro  at  (513)  435-2280. 


WENDELL  P.  SIMPSON  HI,  MAJ,  USAF  Atch 

Manager,  Graduate  Cost  Analysis  Program  Cost  Analysis  Case  Questionnaire 
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AFTT  Graduate  Cost  Analysis  Program 
Cost  Analysis  Case  Questionnaire 


This  document  gives  a  brief  summary  of  the  background  and  intent  of  the  cost  analysis 
cases,  and  proposes  a  set  of  draft  objectives.  In  our  efforts  to  improve  the  GCA 
program,  we  continually  solicit  feedback  from  GCA  graduates,  their  supervisors  and  the 
leadership  of  the  cost  community.  Recent  feedback  indicates  that  we  might  improve  our 
product  if  we  were  to  add  more  opportunities  for  the  students  to  apply  the  theory  we 
teach.  The  cost  cases  are  part  of  a  broader  effort  to  increase  the  ettq>hasis  on 
application  of  theory  in  the  GCA  curriculum  without  de-emphasizing  our  teaching  of  the 
theory  itself. 

Please  understand  that  most  of  the  objectives  listed  on  the  attached  are  already  covered 
somewhere  in  the  curriculunL  For  example,  the  curriculum  already  contains  a  three 
course  sequence  on  developing  and  evaluating  parametric  cost  models.  The  students 
generally  are  exposed  to  estimating  techniques  and  issues  in  isolation  to  allow  for  in- 
depth  study  of  the  topic.  The  weakness  in  the  program  that  we  are  trying  to  address 
with  the  cases  springs  from  the  fact  that  the  objectives  are  sprinkled  throughout  the 
curriculum  and  students  do  not  have  much  opportunity  to  bring  them  together  and 
"estimate”.  The  purpose  of  the  cases  is  to  provide  a  vehicle  to  pull  together  the 
objectives  and  techniques  scattered  throughout  the  curriculum  and  to  integrate  them  into 
a  simulated  estimating  scenario.  We  would  like  your  help  in  identifying  those  skills  that 
should  be  induded  and  integrated  in  the  cases. 

In  addition  to  integrating  concepts  already  in  the  curriculum,  the  cases  provide  an 
opportunity  for  the  student  to  begin  developing  some  skills  that  are  not  covered  in  the 
curriculum.  These  are  skills  that  are  generally  not  addressed  at  the  graduate  level,  but 
can  be  important  to  their  success  in  the  cost  field.  For  example,  we  do  not  currently 
include  in  the  curriculum  any  instruction  on  how  to  construa  a  cost  spreadsheet  While 
the  students  use  spreadsheets  to  support  their  course  work,  they  do  not  have  the 
opportunity  to  construct  a  spreadsheet  that  has  many  different  embedded  cost  equations 
and  that  is  well-designed  in  terms  of  capabili^  to  support  "what-if  exercises.  (This 
should  remain  a  valuable  skill  even  as  we  move  towards  the  "cost  workstation  concept). 

A  cost  estimating  case  provides  a  wonderful  opportunity  to  teach  some  of  these  skills 
before  they  complete  the  program. 

We  would  like  you  to  review  and  comment  on  the  objectives  as  proposed,  and  to  identify 
any  objectives  that  you  feel  ought  to  be  added  to  the  list  When  you  have  your  proposed 
list  completed,  we  ask  you  to  prioritize  the  list  based  on  your  experiences  and  collective 
opinions. 

As  points-of-contact  for  your  organization,  we  encourage  you  to  involve  as  broad  a 
spectrum  of  cost  analysts  as  you  find  practical.  Ideally,  we  would  like  at  least  three 
participants  from  each  organization.  If  possible,  we  ask  that  the  participants  reflect  a 
range  of  experience  in  estimating.  We  feel  it  is  just  as  important  to  consider  the 
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opinions  of  new  estimators  as  it  is  the  opinions  of  the  e]q)erienced  estimators.  In 
addition,  we  would  appreciate  it  if  some  of  the  participants  are  GCA  graduates.  Our 
purpose  is  to  better  equip  the  GCA  students  as  he  or  she  leaves  the  program.  GCA 
graduates  may  offer  some  unique  insights  based  on  their  personal  experiences  after 
completing  the  program. 

Thank  you  for  participating  in  our  project  We  feel  that  your  perspective  is  essential  in 
creating  relevant  problem  situations  in  which  the  students  will  learn  the  skills  that  will  be 
important  to  them  in  their  future  careers. 

Kerrie  Glenn 
Jim  Passaro 
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Use  the  following  to  inrovide  some  basic  data  on  the  participants  in  the  process  of 
developing  objectives: 

Date: _ 

Organization  (circle  one): 

AFCAA  AFMC  ASC  SMC  ESC 

Participants: 

Years  nf  Estimating  Fjtperience  GCA  Ora4ttatC  (Y  OF  N) 

1.) 

2.) 

3. ) 

4. ) 

5. ) 


Please  identify  any  sources  of  data  that  you  feel  may  be  especially  helpful  developing  the 
cost  cases  (IC£  or  POE  documentation,  cost  studies,  cost  research  reports,  etc.) 
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What  spreadsheet  software  is  most  commonly  used  in  your  organization? 


Are  you  presently  using  a  cost  workstation  in  your  organization?  If  so,  which  one?  Do 
you  plan  to  adopt  a  cost  workstation  in  the  foreseeable  future?  Again,  which  one? 


Are  there  one  or  two  parametric  cost  models  that  predominate  in  your  organization?  If 
so,  which  ones? 


Are  there  one  or  two  learning  curve  programs  that  predominate  in  your  organization?  If 
so,  which  ones? 
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:  rank  the  single-dashed  objectives  in  terms  of  the  priority  you  feel  the  thesis  team  should  assign  in  the  process  of  creating  the  cost 
Use  the  space  at  the  bottom  of  the  form  to  identify  objectives  that  you  feel  should  be  added  to  the  list  along  with  their  priority 
ng.  (Note:  the  double-dashed  statements  are  supporting  samples  of  behavior  that  we  might  expect  of  the  student  if  the  objective 
achieved.) 


Interpret  Cost  Performance  Reports  (CPRs). 

—Define  the  various  CPR  performance  measurements  (BCWP,  ACWP,  BCWS,  EAC). 


Appeodix  D: 

Sample  Data  Collection  Sheet 
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CASE  DATA  COLLECTION  WORKSHEET 


Case  Title: _ 

Case  Authors: 


SECTION 


SCENARIO  AND 
ORGANIZATION  INFO. 


DATA  AVAILABLE 


DATA  REQUIRED 


BACKGROUND 

OUTLINE 


SPECIFIC  AREAS  OF 
INTEREST 


LEARNING 

OBJECTIVES 


EXHIBIT  MATERIAL 
NEEDED 
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Appendix  E: 

Case  Clarity  Questionnaire 


74 


Dear  Case  Tester, 


Thanks  a  lot  for  helping  us  out.  Your  insights  will  be  crucial  to  making  the  seminar  class 
(which  is  being  built  around  these  cases)  a  successful  learning  experience.  Please  take  the  time 
to  fully  evaluate  this  case.  Provided  below  are  specific  questions  we  need  you  to  answer  as  fully 
as  possible.  If  you  have  any  additional  comments  for  us,  please  don’t  hold  back-your  feedback 
will  be  incorporated  in  our  final  case  product  Thanks  again  for  your  help!! 


CASE.QIIESTIQKS 

1)  Identify  anything  you  would  add/change/delete  from  the  "Scenario"  section  to  make  it  more 
realistic  and  interesting.  What  did  you  particularly  like  or  dislike  about  that  section? 

2)  Were  your  responsibilities  in  completing  this  case  clearly  identified?  What  would  you 
add/change/delete  in  the  "Organization  Background"  section  to  make  the  overall  case  a  more 
effective  learning  tool? 

3)  Identify  any  of  the  "Ground  Rules/ Assumptions"  that  were  confusing  to  you.  How  would 
you  change  them  to  make  them  more  useful?  Are  there  any  other  assumptions  you  would  add  or 
change? 

4)  What  did  you  particularly  like/dislike  about  the  "System  Background"  section  (including  the 
acquisition  approach  and  target  designator  descriptions)?  Is  there  any  additional  information 
you  feel  would  have  been  helpful?  Identify  any  information  in  this  section  that  was  confusing  to 
you. 

5)  Were  the  attachments/figures  helpful?  (please  explain).  What  would  you  add/change  to  make 
them  more  useful? 

6)  This  question  is  extremely  important  Briefly  outline  the  estimating  methodology  you 
would  Ui>e  to  solve  this  case.  Describe  what  you  believe  will  be  the  major  decision  points  and  the 
overall  flow  of  your  anticipated  methodology. 

7)  If  you  could  add/change/delete  anything(s)  about  this  case,  what  would  it  be  and  how  would 
you  do  it? 

8)  Estimate  how  much  time  you  spent  conducting  your  review. 
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Appendix  F: 

Case  Realism  Questionnaire 
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7  Jun  93 


FROM:  Msgor  Wendell  Simpson 

AFIT/LAS 
2950  P  Street 
WPAFB  OH  45433-7765 

SUBJ:  AFIT  Cost  Analysis  Case  Evaluations 

TO:  Mrs  EUen  Coakley 

ESC/FMC  (Technical  Director) 

9  Eglin  Street 

Hanscom  AFB,  MA  01731-2117 

1.  Earlier  this  year  we  invited  you  to  participate  in  the  development  of  a  set  of 
cost  analysis  cases  to  be  used  in  the  curriculum  here  at  AFIT.  We  asked  you  to 
provide  us  with  your  perceptions  of  the  importance  of  possible  objectives  for  the 
cases.  Based  on  the  responses  we  received  from  the  field,  Captain  Kerrie 
Schieman  and  Captain  Jim  Passaro  have  been  developing  three  cases  to  address 
the  high  priority  objectives. 

2.  Our  goal  is  to  produce  cost  analysis  cases  that  challenge  the  students  and  help 
prepare  them  to  make  some  of  the  analytical  decisions  that  will  be  expected  of 
them  in  the  field.  An  important  step  in  the  process  to  achieve  that  goal  is  to 
obtain  feedback  fix)m  analysts  in  the  field  as  to  the  qualify  and  relevance  of  the 
cases.  We  ask  that  cost  analysts  in.  your  organization  review  the  draft  cases  and 
complete  an  evaluation  form  to  communicate  their  impressions.  The  first  of  the 
draft  cases  and  an  evaluation  form  are  attached. 

3.  In  order  to  incorporate  your  comments  into  their  thesis  and  meet  our  deadlines 
here,  we  will  need  to  receive  yoxir  comments  no  later  than  15  July.  The  students 
in  the  current  graduate  cost  analysis  class  will  be  using  the  cases  during  the 
Slimmer  quarter  beginning  1  July.  If  we  receive  your  evaluations  before  the  end  of 
June,  there  is  a  good  chance  that  we  will  be  able  to  incorporate  your  comments 
before  giving  the  cases  to  the  students. 

4.  Thank  you  for  your  time  and  cooperation.  If  you  have  any  questions,  please 
contact  Captain  Schieman  at  (513)  426-0703  or  Capatin  Passaro  at  (513)  435-2280. 


WENDELL  P.  SIMPSON,  MAJ,  USAF 
Manager,  Graduate  Cost  Analysis  Program 


2  Atch 

1.  Draft  Case 

2.  Evaluation  Form 
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Name; _  Date;. 

Office  Symbol/Phone; _ 


Case  l 

Case  Evaluation  Questions 


1.  Scenario  -  How  could  we  make  the  scenario  more  realistic  and  interesting? 


2.  Organization  Background 

a.  How  could  we  change  this  section  to  make  it  more  complete,  informative  and 
accurate? 


b.  How  should  the  "Groundrules  and  Assumptions”  be  modified  to  help  clarify  the 
case? 


3.  System  Background  ~  Did  this  section  provide  an  approprite  amount  of  technical 
information  given  the  estimating  scenario? 


4.  Acquisition  Approach  ••  Are  there  any  changes  that  would  make  this  section  more 
accurate  and  realistic? 
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5.  Tasking  ~  Did  this  section  clearly  identify  the  student  requirements  and  expectations 
in  the  case? 


6.  SUPPORING  Material  -  How  can  we  improve  the  attachements  and  figures? 


7.  Overall  Impression  -  If  you  could  add,  change  or  delete  one  thing  about  this  case, 
what  would  it  be  and  how  would  you  do  it? 
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Appendix  G: 

Case  Difnculty  Questionnaire 
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CASE  CRITIQUE 


1.  Identify  any  sources  of  information  (outside  the  case  itself)  that  you  felt  were  necessary 
or  especially  useful  in  analyzing  the  case  (i.e.,  specific  class  presentation,  other  students, 
other  source). 


2.  a)  List  the  key  decisions  you  had  to  make  to  complete  the  case. 


b)  Which  decision  was  the  most  difficult  for  you  to  resolve? 


c)  Was  the  decision  described  in  "b"  above  difficult  due  to: 

1.  Case  not  being  clear  (specify  what  was  unclear) 

2.  Necessary  information  omitted  (be  specific) 

3.  Did  not  understand  a  particular  concept  (such  as...) 

4.  Other  (please  explain) 

3.  Estimate  the  total  number  of  hours  you  spent  individually  on  the  case. 


4.  Try  to  rate  the  overall  difficulty  of  the  case  on  the  following  scale  from  1  to  5. 

1.  Not  complex. 

2.  Slightly  complex. 

3.  Reasonably  complex. 

4.  CcMisiderably  complex. 

5.  Extremely  complex. 

5.  Identify  any  cosmetic  changes  you  recommend  for  the  case  (use  reverse  as  needed). 


81 


Appendix  H: 


Spresdsheet  Used  to  Calculate  Ranking  of  Objectives 
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Appendix  I: 
LANTIRN  Case 


! 

i 
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LANTIRN 
COMPONENT 
COST  ANALYSIS  (CCA) 


Prepared  by: 

Captain  Kerrie  G.  Schieman 
Captain  James  R.  Passaro 


SCENARIO 


"Guess  what  Karen,  another  cost  estimate  came  down  the  pipe  today.  As  usual,  they  want 
it  done  yesterday.  It  looks  like  were  gonna  be  busy  for  the  next  few  weeks." 

Karen  Lopez  is  a  member  of  the  Command,  Control,  Communications,  and  Intelligence 
(C^I)  Division  at  the  Air  Force  Cost  Analysis  Agency,  located  in  Crystal  City,  Virginia. 
Karen's  boss.  Major  Andy  Russell,  is  the  C^I  EHvision  Chief.  Karen's  responsibilities 
include  developing  cost  estimates  for  various  Air  Force  C^I  systems  in  support  of 
acquisition  milestone  decisions. 

Major  Russell  leaned  back  in  his  chair  and  folded  his  arms  over  his  chest  as  he  outlined  the 
latest  tasking  to  Karen.  "The  Electronic  Systems  Program  Executive  Officer  (PEO)  has 
directed  us  to  provide  a  component  cost  analysis  (CCA)  for  the  Low  Altitude  for 
Night-Time  Infrared  Navigation  (LANTIRN)  system.  Tm  going  to  count  on  you  to  take 
the  lead  on  this  one."  "So  what's  the  time  frame  on  this  estimate?"  Karen  asked,  her  face 
already  begiiming  to  wrinkle  in  anticipation  of  the  anxiety  Major  Russell's  response  might 
evoke.  "Two  weeks  from  today",  he  replied.  "The  LANTIRN  program  office  used 
contractor  data  and  development  actuals  to  develop  their  program  office  estimate.  Here's 
all  the  information  I  could  get  my  hands  on,"  Major  Russell  stated,  handing  over  a  6" 
stack  of  papers  and  fUe  folders.  Major  Russell  continued,  "Fll  get  with  you  this  afternoon 
to  go  over  exactly  what  I'm  expecting  on  this  one."  At  that  point  Karen  turned  and 
headed  back  to  her  desk. 


ORGANIZATION  BACKGROUND 

The  Air  Force  Cost  Center  was  established  in  1986  to  analyze,  estimate,  and  validate  the 
cost  of  executing  the  Air  Force's  total  program.  In  1991,  it  was  redesignated  the  Air 
Force  Cost  Analysis  Agency  (AFCAA).  The  agency,  located  in  Arlington,  Va.,  near  the 
Pentagon,  reports  directly  to  the  Assistant  Secretary  of  the  Air  Force  (Financial 
Management  and  Comptroller).  AFCAA's  primary  mission  is  to  prepare  component  cost 
aiuilyses  (CCA),  formerly  known  as  Independent  Cost  Estimates,  for  major  defense 
acquisition  programs  required  for  Air  Force  Selected  Acquisition  Review  Council 
(AFSARC),  Defense  Acquisition  Board  (DAB),  and  program  reviews.  The  Cost  Agency 
must  also  prepare  CCAs  for  automated  information  systems  scheduled  for  the  Major 
Automated  Information  Systems  Review  Committee  (MAISARC).  The  AFCAA  also 
develops  cost  models,  methodologies,  and  databases  necessary  to  insure  credible  CCAs 
and  other  cost  estimates/cost  analyses  performed  throughout  the  Air  Force.  AFCAA 
consists  of  four  weapon  system  divisions  and  a  program  control  division.  Figure  1 
displays  an  organizational  chart  of  the  four  weapon  system  divisions  at  the  Cost  Agency. 
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AIR  FORCE  COST  ANALYSIS  AGENCY 
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Figure  1 


URMUNDT 


SYSTEM  BACKGROUND 


The  LANTIRN  Program  was  initiated  to  develop  and  produce  a  system  to  provide 
Tactical  Air  Forces  with  a  low-level,  day  and  night,  un^-the-weather  attack  c^bility 
for  high  performance  single  seat  aircraft  LANURN  will  provide  the  means  by  which 
close  support  aircraft  can  acquire  their  targets  and  deliver  guided  and  unguidod  weapons. 
The  LANTIRN  system  is  presently  intended  for  use  on  the  F-15E,  A-10  and  the  F-16C/D 
model  aircraft 

The  LANTIRN  Program  consists  of  two  prime  hardware  development  efforts~the 
development  of  a  heads-up-display  (HUD)  system  for  both  the  A-10  and  the  F-lb  models, 
and  the  development  of  a  Fire  Control  System  (PCS)  for  use  on  the  F-15,  A-10,  and  F-16 
aircraft  HUD  production  will  be  funded  in  the  respective  aircraft  program  lines.  Marconi 
Avionics  was  awarded  the  HUD  contract  on  18  September  1990. 

The  Fite  Control  System  consists  of  two  separate  sets  of  equipment  each  contained  in  its 
own  pod  suitable  for  underwing  or  under-fuselage  attachment  Either  or  both  pods  can  be 
carried,  depending  on  the  particular  mission  required.  The  equipment  within  the  pods  is 
supplied  by  a  number  of  manufacturers,  but  overall  responsibility  rests  with  Martin 
Marietta  Corporation  as  the  prime  contractor.  The  two  pods  are  the  AN/AAQ-13 
navigation  pod  and  the  AN/AA(>-14  targeting  pod. 

Navigation  Pod.  The  navigation  pod,  shown  in  figure  2,  is  pylon  mounted  and  contains  a 
wide  tield-of-view  forward  looking  infrared  radar  (FLIR)  sensor,  terrain  following  radar 
(TFR),  together  with  the  associated  power  supply,  pod  control  computer,  and  an 
environmental  control  unit  (ECU).  Tlie  navigation  pod  provides  the  pilot  with  night  vision 
for  safe  flight  at  low  level.  The  terrain  following  radar  allows  operation  at  very  low 
altitudes  with  en  route  weather  penetration  and  blind  let-down  capability. 

Targeting  Pod.  The  targeting  pod,  shown  in  tigure  3,  is  also  pylon  mounted  and 
contains  a  wide  and  narrow  field-of-view  FLIR  sensor,  laser  designator/ranger,  automatic 
missile  boresight  correlator  (MBC),  automatic  target  recognizer  (TR),  pod  control 
computer,  power  supply  and  environmental  control  unit  (ECU).  When  the  MBC  and  the 
TR  are  removed  from  the  targeting  pod,  the  remainder  is  referred  to  as  the  target 
designator  subsystem.  The  TR  is  currently  in  advanced  development  and  will  be  added  as 
a  preplanned  product  improvement  to  the  targeting  pod  after  competitive  development 
and  test 

Target  Designator  Subsystem.  The  target  designator  subsystem  of  the  targeting 
pod  is  intended  to  provide  first-pass  attack  capability  at  a  greater  stand-off  range  than 
conventional  systems.  The  target  designator  subsystem  provides  the  laser  energy  for 
illuminating  and  ranging  targets  for  the  delivery  of  conventional  and  laser-guided 
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ENVIRONMENTAL 
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Figure  3 


LANTIRN  Targeting  Pod 


ordnance.  The  unit  is  intended  to  be  one  of  the  most  advanced  systems  of  its  kind.  Of 
modular  construction,  this  lightweight  device  will  be  controlled  by  a  microprocessor  and 
use  digital  interfaces  to  provide  serial  or  parallel  commands  directly  to  the  LANTIRN 
navigation  pod.  The  target  designates  will  have  a  self-contained,  automatic  or  manually 
initiated  built-in  test  amiability,  and  will  be  fitted  with  connectors  for  automatic  test 
equipment  fault  isolation  chedcs. 


ACQUISITION  APPROACH 

The  LANTIRN  development  effort  began  in  1990,  under  a  contract  awarded  to  Martin 
Marietta  by  the  USAF  Aeronautical  Systems  Center  (ASC),  at  Wiight-Patterson  AFB, 
Ohio. 

The  total  system  (Fire  Control  System)  acquisition  plan  will  consist  of  the  following 
phases: 


Engineering  and  Manufacturing  Development  -  the  EMD  phase  includes  the 
design,  development,  fabrication,  qualification,  and  test  of  six  (6)  FCS  pod  sets  (6  target 
pods  and  6  nav  pods).  Tlie  EMD  was  initiated  in  September  of  1990. 

Production  -  Production  lot  1  is  an  option  for  thirty-four  (34)  pod  sets.  Five  (5) 
follow-on  production  buys  ate  planned  to  complete  the  buy  of  720  pod  sets.  The  buy 
schedule  is  as  follows: 

FY96  FY97  FY98  FY99  FYOO  FYOl  TOTAL 

34  138  144  144  144  116  720 

The  targeting  pod's  target  recognizer  (TR)  follows  a  separate  schedule,  with  advanced 
development  continuing  through  FY94,  followed  by  an  18-month  competitive  (two-firms) 
EMD  phase  and  TR  system  test  Production  for  TRs  begins  with  Production  Lot  2  and  is 
the  schedule  is  as  follows: 

FY97  FY98  FY99  FYOO  FYOl  TOTAL 

124  192  144  144  116  720 


TASKING 

As  a  member  of  the  C^I  Division,  you  have  woiked  with  Major  Russell  and  Karen 
Lopez  on  several  past  CCAs.  The  same  afternoon  that  Karen  spoke  with  Major  Russell, 
Karen  briefed  you  on  the  LANTIRN  CCA,  informing  you  that  you  would  be  in  charge  of 
estimating  die  target  designator  subsystem  (atch  1 WBS).  You  will  be  one  of  several 
analysts  working  on  the  LANTIRN  CCA.  The  next  morning  Karen  E-mailed  you  the 
following  list  of  specific  responsibilities: 
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1.  Use  the  analogy  method  to  estimate  the  EMD  and  Production  recurring 
manufacturing  costs  for  the  target  designator  subsystem  (subset  of  the  Targeting  Pod). 
Data  concerning  possible  analogous  systems  and  corresponding  complexity  factors 
developed  by  the  LANTIRN  program  office  engineering  staff  are  provided  in  attachment 
2. 


2.  Normalize  the  data  for  inflation  (the  base  year  will  be  1990). 

3.  Develop  a  spreadsheet  that  automates  your  EMD  and  Production  estimates. 
The  spreadsheet  should  include  the  complexity  factor  and  the  learning  curve 
computations. 

4.  Develop  a  spreadsheet  that  will  integrate  all  subsystem  estimates  and  produce 
an  AF  Form  1537  (Weapon  System  Summary)  for  both  EMD  and  Production.  Separate 
1537s  should  be  prepared  for  base  year,  then  year,  and  current  year  dollars  (6  1537s 
total).  Cost  data  for  the  other  subsystem  estimates  is  found  in  the  cost  analyst  input 
sheets,  which  were  prepared  by  other  members  of  the  CCA  team,  in  attachment  3. 

5.  Finally,  provide  written  documentation  of  your  process  and  the  final 
spreadsheets.  Plea%  be  brief  and  limit  narrative  sections  to  3-4  pages. 

Karen  was  kind  enough  to  provide  you  with  a  copy  of  an  analogous  estimating  flow  chart 
she  used  for  a  past  estimate  (figure  4). 


GROUND  RULES  and  ASSI 


[S 


1.  Martin  Marietta  Corporation,  the  LANTIRN  contractor,  estimates  that 
recurring  costs  for  the  target  designator  in  EMD  will  be  spread  out  over  two  years  (60% 
in  92, 40%  in  93). 

2.  The  target  designator  is  WBS  element  101 1  and  includes  only  the  design  and 
prototype  costs-nonrecurring  dollars  for  such  items  as  tooling,  special  test  equipment, 
and  facilities  are  not  included  (see  attch  1). 

3.  The  burden  rates  for  G&A  and  profit  are  provided  by  Martin  Marietta 
Corporation  through  the  Forward  Fixed  Price  Agreement  proposals.  The  EMD  rate  is 
1.21,  while  the  Production  rate  is  1.27. 


4.  The  estimates  should  be  expressed  in  then  year,  current  year,  and  base  year 
doUars  (FY90$). 

5.  For  inflation/deflation  use  the  January  1993  OSD  Inflation  Rates  for  3600 
(EMD)  and  3010  (production)  appropriations  (attch  4). 
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Figiare  4 


6.  Martin  Marietta  Corporation  uses  a  90%  cumulative  average  cost  improvemrat 
curve  to  estimate  both  the  EMD  and  production  recurring  pod  costs.  This  learning  rate  is 
based  on  Martin  Marietta's  experience  with  similar  past  programs  and  projections  for 
LANTERN. 

7.  An  Independent  Technical  Assessment  Team  (TTA)  validated  the  complexity 
factor  provided  by  the  LANllRN  SPO.  The  learning  curve  slope  provided  by  Martin 
Marietta  was  also  validated  by  the  ETA  team. 

8.  The  analogous  system's  fiscal  year  buy  schedules  with  corresponding 
production  costs  are  provided  in  attachment  S. 
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ATTACHMENT  2 
ENGINEERING  ASSESSMENT 

ANAIQGOUS  SYSTEMS 

PAVE  TACK  -  This  system  was  built  by  Ford  Aerospace  Corporation  and  is  currently 
installed  on  the  F-1 1  lE/F,  RF-4E,  and  F-4E.  Pave  Tack  provides  target  designation 
facilities  for  laser  guided  munition  and  range  to  target  information  for  navigation  and  the 
delivery  of  conventional  weapons.  The  Pave  Tack  system  consists  of  a  pod  containing  a 
turret-mounted  FLIR  detector  and  laser  designator.  The  line  of  sight  is  controlled  by  the 
aircraft  weapon  system  operator  aided  by  a  pod  mounted  digital  computer.  In  a  fully 
integrated  configuration  with  other  aircraft  systems  and  weapons,  the  PAVE  TACK 
system  provides  a  day/night  strike  capability  for  high  speed,  precision  we^n  delivery 
from  high  or  low  altimdes. 

Sharpshooter  -  The  Sharpshooter  system  was  built  by  Marconi  Avionics  as  an  upgrade 
system  for  the  F-14  Tomcat  The  Sharpshooter  provides  round-the-clock  targeting 
capabilities,  and  has  a  narrow  and  wide  FLIR  sensor.  The  stabilized  line  of  sight  and 
continuous  roll  tracker  can  track  either  stationary  or  moving  targets;  it  can  also  track  a 
scene  using  area  correlation.  The  laser  designator  and  ranger  have  analog  and  digital 
aircraft  interface  and  use  programmable  coding.  When  used  in  conjunction  with  Martin 
Marietta's  Pathfinder  (Navigation  Pod),  the  Sharpshooter  provides  a  day/night  strike 
c^ability  for  high  speed,  precision  weapon  delivery  from  high  or  low  altitudes. 


The  LANTERN  engineering  staff  analyzed  the  existing  PAVE  TACK  and  Sharpshooter 
electronics  as  compared  to  the  target  designator  electronics  in  the  LANTIRN  system.  To 
perform  this  comparison  the  LANTIRN  system  was  broken  out  functionally  into  the 
following  subsystems: 

1.  FLIR  target  acquisition  and  digital  scan  converter 

2.  Laser  designator/ranger 

3.  Pod  control  computer 

4.  Gimbal/sovo  system 

5.  Power  supply 

6.  Environmental  control  unit 

7.  Central  electronics  unit 


PAVE  TACK  Analysis.  Each  of  the  above  subsystems  was  examined  against  its 
analogous  subsystem  in  PA^  TACK.  Additionally,  the  engineering  staff  believes  there 
ate  three  weighting  categories:  1)  a  cost  weighting,  representing  how  much  each 
subsystem  contributes  to  the  total  system  cost  2)  a  design  complexity  weighting  assigned 
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by  the  engineers  in  the  complexity  worksheets  shown  below  3)  a  miniaturization  factor 
for  those  items  that  must  occupy  less  space  in  the  LAN  l  lRN  program,  but  perform  the 
same  task  as  in  the  PAVE  TACK.  The  three  weightings  are  multiplied  together  to  derive 
each  subsystem's  weighted  development  complexity  factor.  The  sum  of  these  factors 
should  be  applied  to  the  Development  T^. 

Table  1  shows  how  the  complexity  factor  of  2.0  was  derived  for  the  FLIR  Target 
Acquisition  subsystem.  Both  the  FLIR  Module  Assembly  and  the  Digital  Scan  Converter 
Assembly  were  judged  to  be  essentially  the  same  as  the  comparative  electronics  in  the 
PAVE  TACK  and  therefore  were  assigned  complexity  values  of  1.0.  However,  the 
LANTIRN  FLIR  Optics  package  has  mote  lenses,  mirrors,  mounts  and  alignment 
requirements  than  in  PAVE  TACK-resulting  in  a  complexity  factor  of  4.0.  The 
complexity  values  for  these  three  assemblies  were  given  equal  weighting  and  were 
averaged  to  come  up  with  the  total  complexity  factor  of  2.0.  Tables  1-5  illustrate  the 
derivation  of  complexity  factors  for  the  laser  designator/ranger,  pod  control  computer, 
gimbal/servo  system,  and  power  supply. 

For  data  availability  reasons  complexities  for  the  environmental  control  unit  (ECU)  and 
central  electronics  units  (CEU)  were  estimated  somewhat  differently.  A  complexity  factor 
for  the  LANTIRN  environmental  control  unit  (ECU)  of  3.0  was  arrived  at  by  considering 
the  following  items:  1)  the  LANTIRN  ECU  has  to  handle  twice  as  much  heat  in  a  much 
smaller  volume  and  2)  the  LANTIRN  ECU  uses  liquid  coolanol,  whereas  the  PAVE 
TACK  ECU  uses  air  cooling.  Although  there  is  no  central  electronics  unit  (CEU)  in 
PAVE  TACK,  the  LANTIRN  CEU  is  very  simUar  to  the  PAVE  TACK  pod  control 
computer  (PCC).  Based  on  an  absolute  card  count  in  both  the  PAVE  TACK  PCC  and 
LANTIRN  CEU,  the  CEU  is  1.4  times  as  complex  as  the  PCC.  The  existence  of 
redundant  card  design  in  the  CEU  caused  the  engineers  to  reduce  the  complexity  factor 
from  1.4  to  1.33.  Thus  since  the  LANTIRN  PCC  is  1.5  times  as  complex  as  the  PAVE 
TACK  pod  control  computer,  as  shown  in  table  3,  then  the  LANTIRN  CEU  is  2.0  (1.5  x 
1.33)  times  as  complex  as  the  PAVE  TACK  pod  control  computer. 
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Table  1 

DERIVATION  OF  FLIR  TARGET  ACQUISITION  COMPLEXTIT 


LANTTRN 

PAVE  TACK 

COMPLEXITY 

BASIS/COMMENTS 

FLIR  TARGET 

ACXJUISmON  SYSTEM 

1.  FLIR  OPTICS 

4 

MORE  LENSES  AND  MIRRORS. 

A.  LENSES  (7) 

(1) 

MORE  LENSAORROR  MOUNTS. 

B.  MIRRORS  (4) 

0) 

IMPROVED  COATING  AND 

C.  IJL  WINDOW 

(1) 

MINIATURIZATION 

Z  FLIRM(X>ULE 

1 

ASSEMBLY 

A.  RE-IMAGER 

X 

B.  IMETECTOR/COOLER 

X 

C  SCANNER 

X 

D.  SLIDING  LENS 

X 

E  FDV  (2  movable 

X 

LENSES! 

3.  DIGITAL  SCAN 

ACFTINT.UNrr 

I 

CONVERTER 

A.  SIGNAL  CONVERTER 

CONVERSION 

MULTIPLEXER 

UNIT 

B.  RBORMAIBR 

CRT  DISPLAY 

C  SCAN  SENSOR 

X 

TOTAL  =  6G  =  2 

Table  2 

DERIVATION  OF  LASER  DESIGNATOR/RANGER  COMPLEXITY 


LANTTRN 

PAVE  TACK 

COMPLEXITY 

BASIS/COMMENTS 

LASER  IKSIGNATOR 
SYSTEM 

1.  OPTICS  PATH 

A.  LENSES  (5) 

B.  MIRRORS  (1) 

C  PRISMS  05) 

(5) 

0) 

(0) 

1 

NO  CHANGE  IN  LASER 

TECHNOLOGY 

Z  TRANSMITTER/ 
RECEIVER 

X 

1 

3.  LASER  SYNCHRONISER 
/RANGE  COMPUTER 

X 

1 

4.  TRANSMITTER 
ELECTRONICS 

X 

1 

5.  HV  POWER  SUPPLY 

X 

1 

TOTAL  =  5/5  =  l 
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Tables 

DERIVATION  OF  POD  CONTROL  COMPUTER  COMPLEXITY 


LANTIRN 

PAVE  TACK 

COMW.EXITY 

BASIS/COMMENTS 

POD  CONTROL 
COMPUTER  &  BUS 

1.  COMPUTER 

A.  6.1S  KOPS 

B.  64  K  MEMORY 
(17  BITS) 

DIGITAL 

PROCESSING 

UNIT(DPU) 

312  KOPS 
16.4K 
(16  BITS) 

1.5 

TWICE  THE  SPEED  AND  MEMORY 

OF  PAVE  TACK  DPU.  VARIOUS 
SUBSYSTEM  INTERRUPTS  AND 
SUBSYSTEM  CONTROLS. 

2.  PODBUS(SOOK/SEC) 

X 

IS 

TOTAL  =  3/2  =1.5 

Table  4 

DERIVATION  OF  GIMB  AL/SERVO  SYSTEM  COMPLEXITY 


LANTIRN 

PAVE  TACK 

COMPLEXITY 

BASIS/COMMENTS 

GIMBALSERVO 

SYSTEM 

1.  PRIMARY  MOUtOR 
SERVOS 

SIGHTLINE 

STABILIZATION 

ASSEMBLY 

1 

ADDITIONAL  COMPLEXITY  DUE 

TO  SLIP  RING  ASSEMBLY,  FLR 
DEROLL  SERVO  AND  OPTICS 

SERVOS  (FOV  LENSES). 

2.  SUP  RING  ASSEMBLY 
(4PAniS) 

2 

3.  NOSE  SECTION 

SERVOS 

A.  SHROUD  SERVO 
(PITCH) 

B.  FLIRIX-ROLL 

SERVO 

TURRET SERVO 

X 

3 

TOT/VL  =  6/3=2 

Tables 

DERIVATION  OF  POWER  SUPPLY  COMPLEXITY 


LANTIRN  PAVE  TACK  COMPLEXITY  BASIS/COMMENTS 


POWER  SUPPLY 

SYSTEM 

PROVTOES  POWER  TO; 

2 

ADDITTON/VL  COMPLEXITY  DUE 

A.  P.CC 

X 

TO  MBC  AND  TR  POWER 

B.  M.B.C 

REQUIREMENTS. 

C  TR 

23  DC  OUTPUTS  AND  wn®  INPUT 

D.  COOLER 

X 

RANGE  MULTIPLE  CONTROL 

iERVOSANDCEU 

X 

AND  INTERFACE  FUNCTIONS. 

K  TRACKER 

X 

LANTTRNffAVE  TACK  = 

TOTi\L  =  2 

400 /UHPS/200 /VMPS  =  2 

Provided  below  are  the  average  unit  costs  for  production  and  miniaturization  factors  for 
each  of  the  PAVE  TACK  target  designator  subsystems. 


99 


Cost  f$) 

FUR 

4,840 

1 

Laser  designator 

1,320 

1 

Pod  computer 

1,760 

1 

Gimbal/servo 

880 

1.5 

Power  supply 

1,210 

1.5 

ECU 

990 

1 

CEU 

No  Analogy* 

1 

*  While  the  CEU  is  similar  in  technical  characteristics  to  the  PCC,  the  CEU  cost  should 
only  be  half  the  PCC  cost 

Note:  the  PAVE  TACK  and  Sharpshooter  prototype  contained  15%  structure  and 
85%  electronics,  as  confirmed  by  the  contractor's  Cost  Performance  Report  The 
structural  complexity  of  both  systems  was  judged  as  being  equal.  The  weighted 
complexity  factor  should  be  ai^lied  to  the  value  of  the  electronic  portion  only  to  derive 
the  Target  Designator  T^  and  the  recurring  cost  of  the  6  prototype  units. 


Sharpshooter  Analysis.  The  complexity  factors  for  the  Sharpshooter  system 
were  derived  in  much  the  same  manner  as  for  the  PAVE  TACK.  Tables  6-9  show  how 
the  various  complexity  factors  were  derived.  For  data  availability  reasons  complexities  for 
the  environmental  control  unit  (ECU),  central  electronics  units  (CEU),  and  Gimbal/servo 
system  were  estimated  somewhat  differently.  A  complexity  factor  for  the  LANTTRN 
environmental  control  unit  (ECU)  of  3.0  was  arrived  at  by  considering  the  following 
items:  1)  the  LANTIRN  ECU  has  to  handle  twice  as  much  heat  in  a  much  smaller  volume 
and  2)  the  LANTIRN  ECU  uses  liquid  coolanol,  whereas  the  Sharpshooter  ECU  uses  air 
cooling. 

There  is  no  analogy  for  the  CEU  and  Gimbal/servo  System.  As  in  the  PAVE  TACK 
system,  the  Sharpshooter  PCC  is  quite  similar  to  the  LANTIRN  CEU.  Based  on  an 
absolute  card  count  and  accounting  for  redundant  card  design,  it  was  determined  that  the 
LANTIRN  CEU  is  1.4  times  as  complex  as  the  Sharpshooter  PCC.  Thus  the  CEU  is  1.75 
(1.25  X  1.4)  times  as  complex  as  the  Sharpshooter  PCC. 

Unique  design  considerations  utilized  in  the  Sharpshooter  development  effort  resulted  in  a 
Gimbal/servo  system  that  is  not  directly  comparable  to  the  LANTIRN  system.  A 
subjective  assessment  based  on  the  basic  differences  in  technology-due  primarily  to  the 
lack  of  slip  lings  in  the  Sharpshooter-resulted  in  a  complexity  factor  of  2.5  for  the 
Gimbal/servo  system. 
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Table  6 

DERIVATION  OF  FLIR  TARGET  ACQUISITION  COMPLEXITY 


LANTIRN 

SHARP¬ 

SHOOTER 

COMPLEXITY 

BASIS/COMMENTS 

FLIR  TARGET 

ACQUISITION  SYSTEM 

1.  FUR  OPTICS 

2 

MORE  LENSES  AND  MIRRORS. 

A.  LENSES  (7) 

(4) 

MORE  LENS/MOtROR  MOUNTS. 

B.  MIRRORS  (4) 

(2) 

MINIATURIZATION 

C  I.R.  WINDOW 

0) 

2.  FURMCOULE 

1 

ASSEMBLY 

A.  RE-IMAGER 

X 

B.  DElECTOIUCO(X£R 

X 

C  SCANNER 

X 

D.  SLIDING  LENS 

X 

E.  POV  (2  MOVABLE 

X 

LENSES) 

3.  DIGITAL  SCAN 

ACFTINT-UNIT 

1 

CONVERTER 

A.  SIGNAL  CONVERTER 

CONVERSION 

MULUPLEXER 

UNIT 

B.  REFORMAIER 

CRT  DISPLAY 

C.  SCAN  SENSOR 

X 

T0TAL=4/3  =  1J 

Table? 

DERIVATION  OF  LASER  DESIQNATOR/RANGER  COMPLEXITY 


LANTIRN 

SHARP¬ 

SHOOTER 

COMPLEXITY 

BASISyCOMMENTS 

LASER  DESIGNATOR 
SYSTEM 

1.  OPTICS  PATH 

A.  LENSES  (S) 

B.  MIRRORS  (1) 

C  PRISMS  (5) 

(4) 

a) 

(1) 

1 

IMPROVED  LASER 
SYNCHRONIZATION  THROUGH  USE 
OF  OPTIC  SCALARS.  GREATER 
RANGE 

2.  TRANSMITTER/ 
RECEIVER 

X 

IS 

3.  LASER  SYNCHRONISER 
/RANGE  COMPUTER 

X 

2 

4.  TRANSMITTER 
ELECIRONICS 

X 

1 

5.  HV  POWER  SUPPLY 

X 

t 

TOTAL  =  6.5/5=1.3 


XOl 


Tables 

DERIVATION  OF  POD  CONTROL  COMPUTER  COMPLEXITY 


LANTERN 

SHARP¬ 

SHOOTER 

COMPLEXITY 

BASIS/COMMENTS 

POD  CONTROL 
COMPUTER&BUS 

1.  CCAfPOTER 

A.  615  KOPS 

B.  64  K  MEMORY 
(17  BITS) 

COMPUTER 

ABUS 

400KOPS 

64K 

(17  BITS) 

1^ 

GREAIBR  SPEED  AND  MEMORY 
THAN  SHARPSHOOTER. 

TWICE  THE  SPEED  AND  MEMORY 

OF  PAVE  TACK  DPU.  VARIOUS 
SUBSYSTEM  INTERRUPTS  AND 
SUBSYSTEM  CONTRC^. 

Z  FODBUSCSOOK/SEQ 

350K/SEC 

1.3 

T0TAL=Z5A2=I.2 

Table  9 

DERIVATION  OF  POWER  SUPPLY  COMPLEXITY 


LANTTRN 

SHARP¬ 

SHOOTER 

COMPLEXITY 

BASIS/COMMENTS 

POWER  SUPPLY 

SYSTEM 

PROVIDES  POWER  TO: 

1.5 

ADDITIONAL  COMPLEXITY  DUE 

A.  P.CC 

B.  M3.C 

X 

TO  MBC  REQUIREMENTS. 

23  DC  OUTPUTS  AND  Wn*  INPUT 

C  TR 

RANGE.  MULTIPLE  CONTROL 

D.  COOLER 

X 

AND  INTERFACE  FUNCTIWS. 

E.  SERVOS  ANDCEU 

X 

F.  TRACKER 

X 

TOTAL  =1.5 

The  average  unit  costs  for  procurement  and  miniaturization  factors  for  each  of  the 
Sharpshooter  target  designator  subsystems  are  as  follows: 


FUR 

5,649 

1 

Laser  designator 

1,965 

1 

Pod  computer 

2,205 

1 

Gimba]/sa:vo 

No  analogy 

1 

Power  supply 

1,105 

1.5 

ECU 

1,351 

1 

CEU 

No  analogy* 

1.3 

*  While  the  CEU  is  similar  in  technical  characteristics  to  the  PCC,  the  CEU  cost  should 
only  be  half  the  PCC  cost 
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COST  ANALYST  INPOT  SHBET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Captain  Boyd  DATE:  10  Jul  9X 

UBS  ELEMENT/NUMBER:  Missile  Boresight  Correlator  (MBC)/1012 

DEVELOPMENT 

BRIEF  DESCRIPTION:  Analogy  estimate  was  used  based  on  the 
Pershing  II  program.  The  TASC  engineer's  assessment  of  the 
complexity  resulted  in  a  1.5  factor. 

($  in  000) 


FY90 

FY91 

FY92 

mi 

BY  $  6,668 

5,705 

2,321 

0 

FY94 

FY95 

FY96 

FY97 

BY$  0 

0 

0 

0 

FY98 

mi 

FYOO 

mi 

BY$  0 

0 

0 

0 

TOTAL 

14,694 
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COST  AMALYST  INPUT  SHEET 


lAKTIRN  PROGRAM 


AlUOiTST  NAME:  Captain  Corrente  DATE:  10  July  9X 


WBS  ELEMEMT/NUMBER:  Target  Recognizer/ 1013 


DEVELOPMENT 


BRIEF  DESCRIPTION:  Special  purpose  processor  which  utilizes 
latest  technology  iirqprovements .  The  TR  must  fit  in  a  10"  x  10" 
6“  area.  The  estimate  was  based  on  an  analogous  system — JTIDS-2 
Data  processor. 


FY90 
BT$  19,909 


FY94 
BT$  31,180 

FY9a 

BT$  0 

TOTAL 

75,085 


($  In  000) 


FY91 

8,467 


FY95 

7,071 

0 


FY92 

4,008 


FY96 

0 

mo 

0 


zm 

4,450 


ZZ2Z 

0 

zm 

0 


COST  AMALYST  IWPOT  SHEBT 
LANTIRN  PROGRAM 
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ANALYST  NAME:  Captain  Bond  DATE:  10  July  9X 

WBS  ELEMENT/NDHBER:  Navigation  Pod/1014 

DEVELOPMENT 

BRIEF  DESCRIPTION:  Navigation  pod  used  the  same  analogous  systems 
from  the  target  designator  (PAVE  TACK  &  Sharpshooter) .  The 
complexity  factor  was  1.63. 


($  in  000) 


zm 

mi 

FY92 

zm 

BT$  7,900 

13,525 

7,261 

0 

zm 

zm 

roe 

zm 

BT$  0 

0 

0 

0 

ZX2A 

zm 

FYOO 

zm 

BY$  0 

0 

0 

0 

TOTAL 

28,686 


4 
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COST  AMftLYST  IHPPT  SHEET 


LAMTIRN  PROGRAM 


ANALYST  NAME:  Captain  Bailey  DATE:  11  July  9X 

WBS  ELEMENT/MUMBER:  Terrain  Following  Radar  (TFR)/1015 


pment 


BRIEF  DESCRIPTION:  The  APQ-146  radar  built  by  Texas  Instrument 
was  used  for  the  analogy  estimate.  This  radar  was  used  on  the 
F-111  &  B-IB.  The  learning  curve  on  similar  radars  has  been  95% 
and  therefore  was  used  for  LANTIRN. 


($  in  000) 


FY90 

£m 

zm 

FY93 

BT$  5,222 

6,452 

3,141 

0 

zm 

zm 

FY97 

BT$  0 

0 

0 

0 

ms 

FYOO 

mi 

BY$  0 

0 

0 

0 

TOTAL 

14,815 
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ANALYST  NAME:  Captain  Siitpson  DATE:  9  July  9X 

MBS  ELEMENT/NUMBER:  Software  Development /I 020 

DEVELOPMENT 


BRIEF  DESCRIPTION:  Three  parametric  cost  estimating  models  were 
used — COCOMO,  DOTY,  &  BOEING.  Each  model  is  built  upon  a 
different  data  base.  The  estimate  by  Martin  Marietta  was  within 
the  model's  estimate  &  therefore  deemed  reasonable.  The  MMC 
proposal  was  used  for  the  estimate. 


($  in  000) 


FY9Q 

mi 

FY92 

zm 

BT$  0 

3,185 

3,822 

3,185 

mi 

FY95 

ms 

mz 

BT$  2,549 

0 

0 

0 

ms 

FY99 

FYOO 

mi 

BT$  0 

0 

0 

0 

TOTAL 

12,741 


4 
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COST  AMALYST  INPUT  SHEET 
LANTIRN  PROGRAM 


ANALYST  NAME:  Ms  Lopez  DATE:  12  July  93 

NBS  ELEMENT/NUMBER:  HUD  Development/ 1030 

DEVELOPMENT 

BRIEF  DESCRIPTION:  Provided  by  ASC/FMC  based  on  a  firm- fixed 
price  proposal  from  the  HUD  contractor  (Marconi) .  Estimate 
includes:  test  support,  data  and  SEPM. 


FY90 
BT$  14,623 

FY94 

BY$  1,571 
FY98 

BY$  0 

TOTAL 

28,057 


($  in  000) 


sm 

5,839 


PY92 

2,339 


1,734 

FY99 

0 


me 

243 

gflfl 

0 


zm 

1,708 

Z222 

0 

zm 

0 
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COST  ANALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Mr  Mundt  DATE:  13  July  9X 


WBS  ELEMENT /NUMBER:  Contractor  Test  Support/1041 


DEVELOPMENT 


BRIEF  DESCRIPTION:  23%  of  the  FCS  non- recurring  prime  mission 
equipment.  The  factor  was  derived  from  an  analogous  system  (PAVE 
TACK)  . 


($  in  000) 


gY90 

FY91 

zm 

zm 

BT$  0 

0 

3,295 

5,648 

FY94 

fY95 

mi 

zm 

BY$  5,647 

5,647 

4,235 

0 

FY98 

FY99 

FYOO 

PYOl 

BY$  0 

0 

0 

0 

TOTAL 

24,472 
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COST  AMALYST  INPUT  SHEET 
lAMTIRM  PROGRAM 


ANALYST  NAME:  Mr  Mundt  DATE:  11  July  9X 

MBS  ELEMENT/NUMBER:  Flight-Test  Spares/1042 


BRIEF  DESCRIPTION:  Flight  test  spares  was  5%  of  the  recurring 
prototype  hardware  value.  The  factor  was  provided  by  ESC/TOET, 
based  on  the  team's  description  of  the  LANTIRN  system  &  test 
program  &  TEMP. 


($  in  000) 


FY90 

FY92 

FY93 

BY$ 

0 

0 

2,830 

0 

FY96 

FY97 

BY$ 

0 

767 

0 

0 

FY98 

_ gY99 

FYOO 

. mi 

BY$ 

0 

0 

0 

0 

total 

3,597 
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COST  AMALYST  INPOT  SHEET 
lANTIRN  PROGRAM 


AHALYST  NAME:  Mr  Mundt 


DATE:  10  July  9X 


WBS  ELEMENT/NUMBER:  Government  Test/1043 

DEVELOPMENT 

BRIEF  DESCRIPTION:  Provided  by  ASD/ACC  and  are  based  upon  the 
individual  test  centers'  estimates  of  their  requirements. 


($  in  000) 


PY90 

FY91 

FY92 

FY93 

BY$ 

972 

4,614 

5,518 

7,062 

_ FY94 

FY95 

FY96 

_ m.7 

BY$  10,234 

7,739 

1,737 

0 

FY98 

FYOO 

FYOl 

BY$  0 

0 

0 

0 

TOTAL 

37,876 
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COST  ANALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Captain  Sinpson  DATE:  14  July  9X 

MBS  ELEMENT/NUMBER:  Software  IV&V/1044 

PEVBLOPMEWT 


BRIEF  DESCRIPTION:  20  percent  of  system  and  support  software 
development  costs.  The  factor  was  derived  from  an  analogous 
system.  Discussions  with  software  engineers  at  ESC  indicated 
that  20%  approximates  the  upper  limit. 


($  in  000) 


FY90 

FY91 

PY92. 

_ m3 

BY$ 

0 

636 

2,140 

981 

_ EX25 

_ FYSL6 

_ m.7. 

BT$ 

510 

0 

0 

0 

FY98 

_ ma 

FYOO 

_ FTOl 

BY$ 

0 

0 

0 

0 

TOTAL 

4,267 
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COST  ANALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Mr  Rogers  DATE:  11  July  93 

WBS  ELEMENT/NUMBER:  Aircraft  Integration/ 1050 

DEVELOPMENT 


BRIEF  DESCRIPTION:  The  development  of  aircraft  integration  kits 
was  estimated  by  the  F-16  program  office  and  reviev.ad  by  ASC/FMC. 
F-16  estimates  represent  sufficiency  reviews  of  a  budgetary 
estimate  from  General  Dynamics. 


($  in  000) 


FY90 

FY91 

FY92 

_ Em 

BY$  18,417 

13,632 

24,288 

16,591 

PY94 

FY95 

-..FJfgg 

FY97 

BY$  10,452 

4,334 

2,797 

0 

FY98 

FY99 

FYOO 

FYOl 

BY$  0 

0 

0 

0 

TOTAL 

90,511 
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COST  ANALYST  IWPDT  SHEET 


lAMTIRN  PROGRAK 


ANALYST  NAME:  Mr  Rogers  DATE:  11  July  9X 

MBS  ELEMENT/NUMBER:  HUD  PSE/1061 

DEVELOPMENT 

BRIEF  DESCRIPTION:  Estimate  provided  by  ASC/FMC  based  upon  their 
sufficiency  review  of  the  program  office  estimate. 


($  in  000) 


FY90 

FY91 

FY92 

m3 

BY$  0 

229 

2,640 

5,116 

FY94 

gY95 

_ FY96 

FY97 

BY$  2,694 

0 

0 

0 

_ ma 

FY99 

gYOO 

FYOl 

BY$  0 

0 

0 

0 

TOTAL 

10,679 
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COST  ANALYST  INPUT  SHEET 
lANTIRN  PROGRAM 


ANALYST  NAME:  Mr  Rogers 


DATE:  8  July  9X 


WBS  ELEMENT/NUMBER:  Fire  Control  System  (FCS)  Peculiar  Support 
Equipment  {PSE)/1062 


DEVELOPMENT 


BRIEF  DESCRIPTION:  Estimated  by  The  Analytical  Sciences 
Corporation  (TASC)  using  a  bottom* s-up  approach.  The  support 
Equipment  Requirements  Documents  (SERDs)  were  individually  priced 
and  loaded  for  contractor  and  subcontractor  loadings.  Other 
support  equipment  requirements  were  based  on  an  an  analogous 
system. 


($  in  000) 


FY90 

FY91 

fY92 

FY93 

BY$  0 

0 

71,443 

11,263 

■  fY94 

FY95 

_m£ 

PY97 

BY$  23,274 

442 

0 

0 

-  FYg8 

PY99 

FYOO 

FYOl 

BY$  0 

0 

0 

0 

TOTAL 

106,422 
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COST  ANALYST  INPUT  SHEET 
lAMTIRN  PROGRAM 


ANALYST  NAME:  Captain  Boyd  DATE:  13  July  9X 

NBS  ELEMENT/NUMBER:  Data/ 10 63 

DEVELOPMENT 


BRIEF  DESCRIPTION:  Estimated  as  4%  of  the  Fire  Control  System 
PME.  The  factor  was  derived  using  analogous  programs. 


($  in  000) 


FY90 

_ EX21 

_ FY92 

_ZI21 

By$  1,236 

1,236 

1,236 

1,235 

FY94 

FY95 

FY96 

FY97 

BY$  1,235 

1,235 

0 

0 

_ FY98 

_ma 

_ FYOO 

FYQl 

BY$  0 

0 

0 

0 

7,413 


U6 


COST  ANALYST  INPUT  SHEET 


lACTIRM  PROORMi 


ANALYST  NAME-  Captain  Boyd  DATE:  13  July  93 

WBS  ELEMENT/NUMBER:  Contractor  Training/1064 

DEVELOPMENT 

BRIEF  DESCRIPTION:  Based  on  analogous  systems  and  subjectively 
estimated  based  on  analyst  and  engineering  assessment. 


($  in  000) 


mo 

_ mi 

FY92 

FY93 

BT$ 

0 

238 

0 

0 

_m4 

FY95 

me 

FY97 

BT$ 

0 

0 

0 

0 

FY98 

FYgl 

FYOO 

FYOl 

BY$ 

0 

C 

0 

0 

XQZAL 

238 
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COST  AMALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Mr  Mundt  DATE:  10  July  93 

MBS  ELEMENT/NDMBER:  Part  Task  Trainer/ 10 65 

DEVELOPMENT 


BRIEF  DESCRIPTION:  Estimate  was  furnished  by  ASC/YT  (Trainer 
System  Program  Office) .  Estimate  reviewed  by  the  engineering  euid 
technical  assessment  teams. 


($  in  000) 


_ zx2ja 

mi 

_ zm 

_ zm 

BT$ 

0 

0 

0 

4,217 

FY94 

FY95 

FY96 

gY97 

BT$ 

7,462 

2,463 

0 

0 

-  FY98 

FY99 

mo 

mi 

BT$ 

0 

0 

0 

0 

TOTAL 

14,142 
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COST  AMALYST  IMPUT  SHEET 
lAMTIRM  PROGRAM 


AHMiTST  NAME:  Captain  Simpson  DATE:  14  July  9X 


MBS  EX<miENT/MUMBER:  System  Engineering/ Program  Management /1 070 


DEVELOPMENT 


BRIEF  DESCRIPTION:  Twenty  percent  of  PCS.  Analysis  of  analogous 
system  cost  data  resulted  in  a  remge  from  19%-30%.  Historically 
the  higher  the  PME  the  smaller  the  ratio  of  SE/PM:PME.  The 
LANTIRN  program  PME  was  relatively  large  therefore  a  smaller 
SE/PM  factor  was  used. 


($  in  000} 


_zm 

FY91 

FY93 

BT$  8,154 

7,414 

6,672 

5,189 

mi 

-ms 

ms 

FY97 

BY$  5,187 

3,447 

0 

0 

FY98 

FT99 

FYOO 

FYOl 

BT$  0 

0 

0 

0 

TOTAL 

36,063 
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COST  AMALYST  IHPDT  SHBET 
LAMTIRN  PROGRAM 


ANALYST  NAME:  Ms  Lopez  DATE.  11  July  9X 

MBS  ELEMENT/NUlfBER:  ECO/MR/1081 

PgYSLOPMgMT 

BRIEF  DESCRIPTION:  Based  on  sufficiency  review  by  ASC/FMC. 


($  in  000} 


-gI9Q 

FY91 

FY92 

_jcm 

BT$  0 

0 

23,713 

9,711 

fY84 

_ Em 

—Em 

—Em 

BY$  19,874 

10,163 

1,733 

0 

FY98 

FY99 

FYOO 

FYOl 

BY$  0 

0 

0 

0 

TOTAL 

65,194 
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COST  AMALTST  INPUT  SHEET 


liANTIRN  PROGRAM 


ANALYST  NAME:  Captain  Bailey 


DATE:  10  July  9X 


MBS  ELEMENT/NDMBER:  IR  Detectors/ 10 84 


PBYBLQPIgWT 


BRIEF 

DESCRIPTION: 

Estimates  were 

throughput 

estimates  from 

ASC/FMC. 

($  in 

000) 

FY90 

FY91 

FY92 

_ma 

BY$ 

3,416 

3,057 

2,841 

2,371 

FY94 

FY95 

FJ96 

PY97 

BY$ 

3,104 

3,591 

851 

0 

fY98 

fY22 

FYOO 

FYOl 

BY$ 

0 

0 

0 

0 

TOTAL 

19,231 
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COST  AMALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Capt  Boyd  DATE:  20  July  9X 


MBS  ELEMENT/NUMBER:  Missile  Boresight  Correlator  (MBC)/1012 


PRQDOCTION 


BRIEF  DESCRIPTION:  The  prototype  T1  for  MBC  was  run  down  the 
learning  curve  at  90%  cum  avg  for  the  production  lots.  G&A/Profit 
was  added  on  to  the  lot  data 


tS  in  000) 


FY90 

PY91 

FY92 

FY93 

BY  $  0 

0 

0 

0 

FY94 

FY95 

FY96 

ZZ22 

BY$  0 

0 

16,348 

43,634 

zm 

ZZSii 

zm 

mi 

BY$  39,603 

36,883 

35,154 

27,390 

TOTAL 

BY$  199,012 
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COST  AMALYST  INPUT  SHBBT 


LAMTIRM  JEBOqRAM 


ANALYST  NAME:  Capt  Corrente 


DATE:  23  July  9X 


MBS  ELEMENT /NUMBER:  Target  Recognizer/ 1013 
PRODUCTION 


BRIEF  DESCRIPTION:  The  prototype  T1  for  the  TR  had  a  penalty 
factor  applied  for  the  size  of  the  unit.  The  engineers  did  not 
believe  the  penalty  should  be  used  in  the  production  estimate. 
However,  a  production  penalty  was  applied  for  the  anticipated 
lower  production  yield.  The  new  T1  was  regressed  down  the 
learning  curve  to  produce  the  lot  r'osts.  G&A/Profit  was  then 
applied. 

($  in  000) 


mo 

mi 

m2 

mi 

BY  $  0 

0 

0 

0 

FY94 

FY95 

me 

FY97 

BY$  0 

0 

0 

26,967 

FY98 

FY99 

FYOO 

FYOl 

BY$  32,647 

22,351 

21,295 

16,588 

TOTAL 

BY$  119,848 
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COST  AHALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Capt  Bond  DATE:  22  Jul  9X 

MBS  ELEMEMT/MUMBER:  Navigation  Pod/ 1014 

PRODUCTION 

BRIEF  DESCRIPTION:  The  prototype  T1  was  run  down  the  learning 
curve  for  the  Nav  pod.  The  G&A/ Profit  was  then  applied 
accordingly. 

($  in  000) 


mo 

mi 

PY92 

ma 

BY  $  0 

0 

0 

0 

£ZM 

zm 

m.6 

FYai 

BY$  0 

0 

51,138 

136,481 

mo 

ma 

mfl 

mi 

BY$  123,875 

115,372 

109,960 

85,679 

TOTAL 

BY  $  622,505 
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COST  AMALYST  IWPDT  SHEET 
lANTIRlI  PROGRAM 


# 


ANALYST  NAME:  Capt  Bailey  EATS:  22  Jul  9X 

MBS  ELEMENT/NDMBER;  Terrain  Following  Radar  TFR/1015 
PROPnCTION 

BRIEF  DESCRIPTION:  The  prototype  T1  value  was  run  down  the  95 
percent  lanit  slope  (Tl's  experience  curve)  to  produce  the  TF 
radar  recurring  production 


BY  $ 

FY90 

0 

FY91 

0 

FY94 

FY95 

BY$ 

0 

0 

gT98 

FY99 

BY$ 

79,953 

77,240 

TOTAL 

BY$ 

400,402 

($  in  000) 


FY92 

mi 

0 

0 

£Z2£ 

FYIZ 

25,992 

81,948 

mo 

zm 

75,460 

59,809 
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COST  ANALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Capt  Bond  DATE:  22  Jul  9X 


MBS  ELEMENT/NDMBER:  Tooling/ 1016 
PRODDCTION 

BRIEF  DESCRIPTION:  Tooling  costs  was  calculated  by  appp lying  a 
factor  of  13.45  to  the  LANTIRN  FCS  Production  Tl.  It  was  from 
the  PAVE  TACK  system.  The  PAVE  TACK  system  was  used  because 
insight  was  available  on  the  specific  non-recurring  data.  The 
tooling  category  includes  the  cost  for  basic  and  rate  tooling, 
special  test  equipment,  manufacturing  layout,  and  facilities. 

($  in  000) 


PY90 

FY91 

FY93 

BY  $  0 

0 

0 

0 

FY94 

FT35 

ZX22 

BY$  0 

0 

94,202 

0 

FY98 

sm 

expo 

mi 

BY$  6,086 

0 

0 

0 

total 

BY$  100,288 
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COST  ANALYST  INPOT  SHEET 
lANTIRM  PRQgHAM 


ANALYST  NAME:  Mr.  Rogers  DATE:  21  Jul  9X 


WBS  ELEMENT /NUMBER:  FCS  Peculiar  Support  Equipeinnt /1061 
PROPPCTION 

BRIEF  DESCRIPTION:  Requirements  for  43  sets  of  FCS  support 
equipment  at  three  levels  of  maintenance  were  costed  using  a 
bottoms-up  approach.  ASC/FMC  added  an  amount  to  procure  pod 
loaders  and  transponders  based  upon  their  sufficiency  review  of 
the  estimated  dollar  requirements. 

($  in  000} 


£.YS.Q 

FY91 

FY92 

mi 

BY  $  0 

0 

0 

0 

FJ9.4 

ms 

FY96 

mi 

BY$  0 

0 

0 

155,824 

FY98 

ma 

FYOO 

FTOl 

BY$  62,590 

62,590 

62,590 

54,764 

COST  AMALYST  INPUT  SHEET 


lAMTIRM  PROGRAM 


ANALYST  NAME:  Capt  Boyd 


DATE:  23  Jul  9X 


WBS  ELEMENT/NUMBER:  Data/1063 


PBOPJIg.T.lQM 


BRIEF  DESCRIPTION:  Production  data  was  estimated  at  1  percent  of 
the  FCS  Prime  Mission  Equipment.  That  factor  has  been  used  on 
ESC  programs  with  large  quantity  buys  (e.g.,  TACAN,  JTIDS,  SEEK 
TALK)  and  is  consistent  with  recent  usage  at  ASC. 


($  in  000) 


FY90 

£Z21 

FY92 

FY93 

BY  $  0 

0 

0 

0 

FY94 

sns. 

¥193 

mz 

BY$  0 

0 

2,551 

4,750 

FY98 

zm 

BCflP 

mi 

BY$  4,393 

4,038 

3,867 

3,024 

TOTAL 

BY$  22,623 
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COST  ANALYST  INPUT  SHEET 
lANTIRN  PROGRAM 


AHALYST  NAME:  Capt  Boyd  DATE:  19  Jul  9X 

WBS  ELEMEMT/NUMBER:  Loaders /transporters /I 06 6 

PRODUCTION 

BRIEF  DESCRIPTION:  Estimates  were  extracted  from  firm  contractor 
proposals 

($  in  000) 

PY92  FY93 

0  0 

FY96  mi 

2,608  1,739 

FYOQ  FYOl 

1,304  0 

TOTAL 

BY$  8,839 


FY90 
BY  $  0 


FY91 

0 


BY$ 


m-i 

0 


zm 

0 


FY98 

BY$  1,594 


gyaa 

1,594 


I 
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COST  AMALYST  INPUT  SHEET 
lANTIRN  PROGRAM 


ANALYST  NAME:  Capt  Simpson  DATE:  22  Jul  9X 


WBS  ETiRMBNT/NOM?  ^R:  Systems  Engineer ing/ Program  Mangement  /1070 


PROPPCTIQM 


BRIEF  DESCRIPTION:  The  estimating/ technical  teams  evaluated  the 
peak  staff  loading  in  the  PAVE  TACK,  TADS/PNVS,  and  Sharpshooter 
production  programs.  The  evaluation  disclosed  that  peak  loading 
on  the  former  was  about  85  personnel  and,  on  the  later  about  95 
personnel.  The  team  concluded  that  peak  loading  on  LANTIRN 
should  be  approximately  90  personnel  in  FY96  and  estimated  their 
costs  based  upon  MMC  average  1992  SE/PM  labor  rates  used  in  the 
May  1992  proposal. 


($  in  000) 


FY90 

FY91 

zm 

FY93 

BY  $  0 

0 

0 

0 

ms 

FY96 

FY97 

BY$  0 

0 

20,692 

7,445 

gY98 

FY99 

FYOO 

mi 

BY$  6,551 

6,427 

6,372 

6,340 

TOTAL 

BY$  53,827 
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COST  AKALYST  INPUT  SHEET 


lAMTIRH  FRQflRAM 


ANALYST  NAME:  Capt  Corrente  DATE:  22  Jul  9X 

MBS  ELEMENT/NUMBER:  Tech  Modernization/ 10 82 

PRODOCTION 

BRIEF  DESCRIPTION:  Technology  Modernization,  as  based  on 
negotiated  contract  and  priced  options. 


FY90 
BT  $  0 

FY94 
BY$  0 

FY98 
BY$  0 

TOTAL 
BY$  4,772 


($  in  000) 

FY91  FY92  SlSl 

0  0  0 

zns.  roe  uai 

0  4,772  0 

FY99  exqq  mi 

0  0  0 
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COST  AMALYST  INPUT  SHEET 


lANTIRN  PROGRAM 


ANALYST  NAME:  Ms.  Lopez  DATE:  30  Jul  9X 

MBS  ELEMENT/NUMBBR:  Engineering  Change  Order/Reserve  Mgt/1081 

PROPPCTIQM 


BRIEF  DESCRIPTION: 

ECO/MR 

was 

based  on  a 

sufficiency  review 

the  ASC/FMC  estimate 

• 

($ 

in  000) 

FY90 

2X21 

zm 

BY  $  0 

0 

0 

0 

2X21 

FY95 

Z3C2fi 

FY97 

BT$  0 

0 

44,919 

57,960 

jEm 

zm 

PTOO 

zm 

BT$  23,184 

23,184 

23,184 

10,143 

TOTAL 

BT$  182,574 


t 
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COST  AMALYST  INPOT  SHEET 
lAMTIRN  PROGRAM 


ANALYST  NAME:  Capt  Corrente  DATE:  25  Jul  9X 

MBS  ELEMEMT/NUMBER:  Award  Fee/1083 

PRODOCTION 


BRIEF 

DESCRIPTION: 

Award  Fee  was 

based  on  prior 

contractual 

award 

fee  arrangement. 

($  in 

000) 

FY9Q 

PY91 

FY92 

FY93 

BY  $ 

0 

0 

0 

0 

£XM 

pyae 

FY97 

BY$ 

0 

0 

12,461 

0 

FY98 

FY99 

FYOO 

FYOl 

BY$ 

0 

0 

0 

0 

TOTAL 


ANALYST  NAME:  Mr.  Mundt 


DATE:  24  Jul  9X 


NBS  ELEMEMT/NUMBER:  IR  Detectors/1084 
PRODDCTION 

BRIEF  DESCRIPTION:  The  IR  Detectors  were  extracted  from  firm 
contractor  proposals. 

($  in  000) 

FY90  mi  zm  mi 

BY  $  0  0  0  0 

FY94  FY95  FY96  FY97 

BY$  0  0  3,111  0 

FY98  FY99  FYOO  Zm 

BY$  0  0  0  0 

TOTAL 
BY$  3,111 
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COST  AMALYST  IHPDT  SHBBT 
lAMTIRM  PROGRAM 


ANALYST  NAME:  Capt  Siirpson  DATE:  22  Jul  9X 

MBS  ELEMENT/NUMBER:  Initial  Spares/1090 

PRODOCTION 

BRIEF  DESCRIPTION:  Initial  Spares  are  estimated  by  applying  AFLC 
cost  factor  to  the  program  estimates  for  FCS. 


($  In  000) 


FY90 

FY91 

PY92 

FY93 

BY  $  0 

0 

0 

0 

£X2i 

m7 

BY$  0 

0 

52,599 

177,792 

FY98 

FY99 

mo 

mi 

BY$  41,586 

0 

0 

0 

TOTAL 

BY$  271,977 
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••  aAw  ••  AiKCRArt  rRocuumiiT  ooioi  eso  batm  nabcm  i»>s 


!0>9  S.S29  l.«17  a.7B«  I.StO  2.«»5  2.«27  2.2«9  2.2*»  2.2«2  2.117  2.020  1.079  1.020 
024  9.402  1.104  2.040  2.417  2.990  2.401  2.419  2.149  2.291  2.144  2.079  2.010  1.071 
029  1.477  1.172  2.010  2.409  2.404  2.919  2.440  2.107  2.100  2.212  2.120  2.041  2.014 
024  1.991  1.242  2.074  2.794  2.444  2.901  2.921  2.440  2.191  2.240  2.147  2.100  2.090 


••  WeiOHTED  **  AZRCRArr  PROCURCHENT  (3010)  OSO  RATES  MARCH  1991 
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ATTACHMENT  5 

ANALOGOUS  SYSTEM  PRODUCTION  DATA 


PAYE  TACK: 

The  PAVE  TACK  program  includes  6  development  units  and  149  production 
units.  The  lot  buys  with  the  total  lot  cost  ate  provide  in  the  following  table.  Note,  the 
dollars  are  in  then  year  dollars,  expressed  in  thousands. 


FY81 

TOTAL 

PROD 

6 

13 

52 

60 

24 

149 

$546 

$439 

$190 

The  Sharpshooter 

The  Sharpshooter  program  includes  4  development  units  and  200  production  units. 
The  lot  buys  with  the  average  lot  cost  are  provide  in  the  foUowing  table.  Note  the  dollars 
are  in  then  year  dollars,  expressed  in  thousands. 


££82 

TOTAL 

4 

20 

55 

55 

55 

15 

200 

$805 

$595 

$490 

$435 

$130 

« 
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Appendix  J: 
C-l?  Case 


t 
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COST  ESTIMATING 
AT  THE 

C-1 7  PROGRAM  OFFICE 


Prepared  by: 

Captain  Kerrie  G.  Schieman 
Captain  James  R.  Passaro 


SCENARIO 


The  C-17  System  Program  Office  (SPO)  is  gearing  up  for  its  cost  estimate  to  support  a  major 
acquisition  milestone  decision.  Specifically,  the  C-17  program  is  approaching  the  milestone  three 
productio\i  decision.  Ms  Gloria  Himel  is  tl^  Chief  of  the  Formulation  Section  (YCFFA)  fcx*  the 
C-17  Financial  Managemrat  Division.  She  has  called  a  much  anticipated  meeting  for  all  her  cost 
analysts  to  discuss  the  specific  details  of  the  impending  estimating  effort 

Captain  Terry  Vandergrift  is  one  of  7  analysts  (see  atch  1)  who  crowded  into  Gloria's  office  for 
the  meeting.  Having  just  recently  arrived  at  the  program  office,  Terry  was  somewhat 
apprehensive  about  his  first  involvement  with  a  major  estimate.  Terry's  previous  assigrunent  was 
at  the  Air  Force  Institute  of  Technology,  where  he  earned  a  Master's  of  Science  in  Cost  Analysis. 
However,  Terry  had  no  previous  acquisition  experience.  Gloria  cleared  her  throat  and  began. 
"Alright  everybody,  we've  only  got  three  months  to  complete  this  estimate.  I've  looked  at  the  past 
project  you've  all  been  working  on,  and  I  put  together  a  roster  that  outlines  what  I  expect  each  of 
you  to  accomplish  for  this  estimate."  Gloria  passed  out  the  roster  to  each  analyst  in  the  office 
(atch  2). 

Terry  immediately  scarmed  the  roster  and  began  to  ponder  what  approach  he  would  need  to 
employ  to  meet  Gloria's  schedule,  (^stions  of  data  availability  and  possible  points  of  contact 
began  to  fill  his  mind.  But  before  any  of  these  thoughts  could  solidify,  Gloria  interjected,  "I 
probably  don't  need  to  remind  you  how  much  scrutiny  last  year’s  estimate  received  because  of  the 
cost  growth.  So  be  prepared  to  support  your  estimate  in  front  of  General  Scott"  With  that  the 
meeting  was  adjourned,  but  before  Terry  could  get  out  the  door  Gloria  stated,  "Terry,  hold  on  a 
minute  I  need  to  talk  to  you  about  your  estimate."  Terry  quickly  responded  "sure",  but  inside  he 
couldn't  help  but  wonder  what  else  was  in  store  for  him. 

Gloria  pulled  a  chair  away  from  the  conference  table  and  took  a  seat  across  from  Terry.  "Terry, 
your  portion  of  the  estimate  is  definitely  going  to  be  a  high-vis  area.  Last  year  it  had  the  largest 
cost  growth  in  die  program,  so  it  will  definitely  be  an  area  of  concern  for  OSD  this  year."  Gloria 
continued,  "We  want  to  eliminate  any  doubts  about  the  validity  of  your  estimate.  Mr  Strobel  (the 
program  control  chief)  has  requested  you  perform  a  cross-check  estimate  of  your  production 
sustaining  engineering  estimate.  If  you  have  any  questions  at  all,  let  me  know."  Terry  stood  up 
and  replied,  "Thanks  a  lot  Gloria.  I'll  get  going  with  the  research  and  get  back  to  you  if  I  have  any 
questions.” 


a 
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ORGANIZATION 


The  C-17  program  office  was  established  in  May  of  1986.  It  is  part  of  the  Aeronautical  Systems 
Center  (ASC)  located  at  Wiight-Patterson  AFB,  CMiio.  Provided  below  is  an  organizational  chart 
of  the  program  office. 


c-17  SYSTEM  PfiOGKAM  OFFICE 


Rguie  1 


SYSTEM 

The  C-17  A  was  developed  to  meet  the  force-projection  requirements  of  the  United  States.  It  is  a 
multi-engine  turbofan  heavy-lift,  air  lefuelable  cargo  transport,  designed  to  provide  inter  and 
intratheater  airlift  of  all  classes  of  military  cargo,  including  outsize.  It  will  be  able  to  operate 
routinely  in  small,  austere  airfields  (3,000  ft  x  SK)  ft)  previously  restricted  to  C-130s,  and  will 
provide  the  first  capability  to  airland  or  airdiop/extract  outsize  cargo  in  the  tactical  environment 
Configuration  variations  will  permit  die  aircraft  to  air  deliver  a  variety  of  oversize  combat  and 
support  equipment  including  combat  equipped  troops,  paratroopers,  passengers,  litters,  pallets, 
20-40  foot  containers,  and  tolling  stock,  or  varying  combinations  of  each. 

The  C-17  will  provide  additional  capability  for  rapid  inter-theater  deployment  of  combat  forces 
and  provide  for  the  rapid  mobility  requirements  of  a  modem  Army  within  a  theater  of  operation. 
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This  aircaft  is  the  first  military  transport  to  feature  a  full  digital  fly-by-wire  control  system  and 
two-ciew  cockpit,  with  two  full-time,  all-function  Heads-Up  Displays  (HUDs)  and  four 
multifunction  electronic  displays.  Provided  below  is  a  suimnary  of  the  major  technical  and 
operational  characteristics  of  the  C- 17: 


Characteristics 


Length 

174  feet 

Height 

55.1  feet 

Wing  Span 

165  feet 

Wing  Sweep 

25  degrees 

Wing  Area 

3,8(X)  square  feet 

4  Pratt  &  Whitney  2040$ 

Thrust  Rating 

40,700  lbs 

Max  Take-off  Gross  Weight 

580,000  lbs 

Max  Payload 

172,200  lbs 

Cruise 

.77  Mach 

CONTRACT  INFORMATION 

McDonnell  Douglas  Corporation  of  Long  Beach,  California,  was  selected  as  the  selected  prime 
contractor  in  August  1981  and  received  a  low-level  research  and  development  contract  the 
following  July.  This  was  intended  to  cover  ^  17  technologies  that  would  also  benefit  other  airlift 
programs,  while  preserving  die  option  to  proceed  to  Engineering  and  Manufacturing 
Development  (EMD)  work  on  the  C-17.  EMD  was  approved  in  February  1985.  Initial 
procurement  funding  was  authorized  in  the  FY  1990  budget,  together  with  continued  R&D.  The 
contract  is  a  Fixed  Price  Incentive  Hrm  (FPIF)  contract  for  development  and  two  production 
options  (lots  1  and  2).  The  contract  has  a  130%  ceiling  widi  an  801/20  share  ratio  and  13%  fee. 

Subcontractors  for  the  C-17  program  include  Beech  Aircraft  Corporation  (composite  winglets), 
Delco  Hectronics  Corporation  (mission  computer  and  electronic  display  system),  Grumman 
Aircraft  Systems  (ailerons,  rudder,  and  elevators),  GEC  Avionics  (advanced  heads-up  display) 
LTV  Aircraft  Products  (vertical  and  horizontal  stabilizers,  engine  nacells),  Honeywell 
Incorporated  (support  equipment  and  air  data  computers),  Martin  Marietta  (tailcone),  and  (3C 
Incorporated  (electronic  flight-control  system). 


CURRENT STATUS 

■» 


The  C-17  program  is  currently  at  the  end  of  the  EMD  phase  of  the  acquisition  process.  The  C- 
17  made  its  first  flight  on  September  15, 1991.  The  test  program  now  includes  five  flight  test 
aircraft  (4  production  units  and  1  EMD  unit)  and  two  ground  test  articles  (for  static  and  durability 
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testing).  As  of  January  19, 1993,  the  five  test  aircraft  had  flown  267  missions  for  mwe  than  930 
hours.  The  program  is  now  in  initial  operational  testing  and  has  accomplished  many  major  test 
events,  including  aerial  refueling,  shtHt-field  landings,  and  formation  flight  The  C-17  has  already 
established  14  new  world  records  for  payloads  flown  to  specific  altitudes  for  particular  aircraft 
weight  classes.  Twelve  production  aircraft  were  funded  tetween  fiscal  years  1990  and  1993.  A 
total  buy'of  150  C-17s  is  currently  planned. 


ACQUISITION  STRATEGY 

The  EMD  schedule  entailed  producing  three  test  articles:  one  for  flight  testing,  one  for  static 
testing,  and  one  for  durability  testing.  Flight  testing  is  being  conducted  at  the  Edwards  AFB 
Flight  Test  Center.  After  completing  flight  testing,  this  article  will  be  reconfigured  for 
production.  The  static  and  durability  articles  were  assembled  on  the  production  line,  however, 
they  are  not  fully  produced  aircrafts  (no  avionics,  or  inner  guts  to  the  plane).  In  other  words,  the 
static  and  durability  articles  were  for  ground  testing  only.  The  ground  testing  of  these  articles 
was  performed  at  Ae  McDonnell  Douglas  Plant  Illustrations  of  the  static  aiKl  durability  articles 
undergoing  testing  are  provided  in  attachments  3  and  4,  respectively.  The  current  production 
schedule  is  for  150  aircraft  to  be  procured  on  a  full  funding  basis  over  eleven  years,  beginning  in 
FY90  and  ending  in  FY2000.  Provided  below  is  the  current  buy  schedule,  followed  by  the 
delivery  schedule. 


FY90 

FY91 

FY92 

FY93 

FY94 

FY9S 

FY9< 

FY97 

FY98 

FY99 

FYOO 

FYOl 

FY02 

BUY 

2 

2 

4 

4 

6 

12 

24 

24 

24 

24 

24 

. 

. 

- 

- 

- 

5 

4 

6 

12 

24 

24 

24 

24 

24 

3 

The  first  four  production  aircraft  will  be  configured  and  used  as  test  aircraft  After  the  test 
program  is  completed,  these  test  aircraft  will  be  reconfigured  as  production  aircraft  and  deployed. 

RESEARCH  EFFORT 

After  Gloria's  meeting  Terry  returned  to  his  desk  and  began  looking  over  the  responsibilities 
roster  Gloria  had  given  him  earlier.  He  quickly  outlined  what  he  felt  the  major  efforts  for  this 
estimate  would  be: 

^  Estimate  the  EMD  portion  of  sustaining  engineering  labor. 

2)  Estimate  the  production  portion  of  sustaining  engineering  labor. 

3)  Perform  a  cross-check  of  the  production  sustaining  engineering  hours  using  an 
alternative  methodology. 

4)  Evaluate  the  new  Not  to  Exceed  (NTE)  contractor  proposals  (atch  5)  to  determine  if 
the  learning  curve  should  be  adjusted  with  a  "rate"  application.  This  evaluation  will  be  based  on 
the  resulting  statistics  of  the  rate  application. 

5)  Prepare  a  briefing  to  support  the  analysis  and  methodology  (5-10  minutes). 

Terry  decided  to  use  the  above  outline  to  guide  his  research  efforts.  He  began  with  a  visit  to  the 
C-17  Cost  Branch  files.  There  he  found  what  he  was  looking  for-a  copy  of  last  year’s  "Blue 
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Book”  (annual  estimate)  documentation.  He  quickly  located  the  EMD  sustaining  enginemng 
section  of  the  estimate,  where  he  noted  that  an  Estimate  at  Compl^on  (EAC)  api»oach  had  been 
used.  The  EAC  demonstrated  that  EMD  was  60%  comply  last  year.  Terry  copied  down  the 
EAC  formula  that  had  bera  used. 

EACemd  =  ACWPcum  +  {(BAC  -  BCWPcuiii)/l(^*SPIcuiiiW.75*CPIc^ 

He  then  thumbed  over  to  the  production  sustaining  engineering  section  of  die  annual  estimate. 
Last  year's  estimate  seemed  relatively  straight  forward—they  had  used  the  EMD  sustaining 
engineering  labor  estimate  as  the  T1  for  the  [voduction  sustaining  engineering  labor.  In 
conducting  his  research  he  also  noted  that  two  significant  issues  had  arisen  over  the  last  year 
structural  problems  had  caused  numerous  design  changes,  and  the  flight  test  program  was 
extended,  causing  increased  concurrency  between  EMD  and  Production.  Tmy  then  made  copies 
of  the  pages  he  felt  would  be  helpful  and  went  back  to  his  desk. 

Terry's  initial  research  efforts  had  paid  off-he  was  beginning  to  feel  more  comfortable  with  the 
scope  of  this  effort,  but  he  still  wasn't  sure  how  to  approach  the  cross-check  of  the  production 
estimate.  So  he  decided  to  do  a  little  more  research.  He  left  his  office  and  went  across  the  base 
to  the  Aeronautical  Systems  Center  Cost  Library.  There  he  was  able  to  find  several  Component 
Cost  Analyses  (CCAs-formeiiy  referred  to  as  Independent  Cost  Estimates)  that  had  been 
performed  by  various  organizations  in  the  past  Realizing  that  the  purpose  of  a  CCA  is  essentially 
to  cross-check  a  program  office  estimate  by  using  different  cost-estimating  methodologies,  Terry 
felt  these  documents  might  reveal  a  feasible  cross-check  for  his  production  engineering  labor 
estimate. 

In  one  of  the  CCAs  he  discovered  that  the  Cost  Agency  had  used  an  analogous  methodology  to 
estimate  sustaining  engineering  labor.  Specifically,  the  Cost  Agency  had  used  an  in-house 
database  diey  developed,  called  the  Cost  Estimating  System  (CES).  This  system  collected 
Contractor  (^ost  Data  Report  (CCDR)  data  from  most  of  the  aircraft  in  the  Air  Force  inventory. 
He  decided  this  could  be  quite  useful  in  conducting  his  cross-check.  He  checked-out  the  CCA 
from  the  library  and  returned  to  the  C-17  program  office. 

The  next  task  in  his  cross-check  effort  involved  conducting  research  devoted  towards  selecting 
^propriate  analogous  systems.  His  efforts  resulted  in  the  foUowing  list  of  systems:  C-5A,  C-130, 
KC-13S,  C-141,  and  B-IB.  The  CES  database  provided  Tls  and  slopes  (based  on  unit  theory) 
for  the  sustaining  engineering  and  recurring  manufacturing  hours  for  each  system.  The  sustaining 
engineering  hoursAb  and  recurring  manufacturing  hoursAb  for  each  aircraft  were  derived  by 
regressing  the  hours  to  develop  the  Tls  and  slopes  provided  in  the  following  tables. 

Sustaining  Engineering  flirsAb) 


B-IB 

C-5A 

C-130 

C-141 

KC-135 

SLOPE 

49.9% 

67.2% 

67.9% 

70.3% 

68.4% 

3.11 

2.97 

3.88 

1.52 

2.3 
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Recurring  Manufacturinf  fhrs/lb) 


B-IB 

C-5A 

C-130 

C-141 

KC-135 

SLOPE 

77.6% 

73.9% 

75.0% 

76.4% 

75.3% 

19.34 

15.58 

16.99 

12.54 

15.69 

He  selected  these  aircraft  based  on  their  ability  tt)  represoit  varying  age,  complexity,  size,  and 
performance  characteristics.  The  Cost  Agency  used  the  analogous  program  database  to  develop  a 
cost  estimating  relaticmship  (CER)  of  recurring  engineering  hours  as  a  pncentage  of  recurring 
manufacturing  hours.  This  relationship  was  developed  to  show  any  effect  on  recurring 
engineering  from  changed  manufacturing  hours  due  to  the  introduction  of  composite  materials. 
Terry  noted  that  the  number  of  production  lots  for  each  of  the  past  programs  varied  from  S  to  8. 
Terry  also  collected  the  projected  C-17  manufacturing  hour  spread  from  the  cost  analyst  in  charge 
of  manufacturing  (provided  in  the  following  table).  Terry  thought  this  could  provide  a  good 
starting  point  to  develop  his  production  cross-check. 


1  FY 

K!3i 

91 

92 

93 

94 

95 

96 

97 

98 

99 

BS 

8.0 

6.24 

9.5 

8.08 

9.23 

14.8 

26.9 

23.89 

21.79 

20.57 

10.53  1 

(hours  expressed  in  millions) 


Terry  then  turned  to  the  task  of  die  learning  with  rate  analysis.  Terry  contacted  the  analyst  who 
had  woriced  this  section  last  year,  and  was  able  to  get  a  notebook  that  contained  documentation 
on  learning  curves  and  rate  adjustments.  The  documentation  stated  that  because  the  C-17 
{Hogram  office  is  faced  with  the  problem  of  estimating  the  impacts  of  many  different  quantity 
profiles  with  limited  time  and  resources,  a  methodology  was  needed  to  better  handle  the  task  of 
quantifying  the  impacts  of  buy  profile  changes.  The  rate  adjusted  learning  curve,  which  helps 
quantify  the  direct  cost  impact  of  changes  in  rate,  incorporates  a  parameter  for  production  rate 
directly  into  the  learning  curve  equation  ((^).  The  theory  is  the  more  units  produced  in  a  lot  the 
lower  the  unit  cost  for  that  lot  (the  fixed  costs  are  allocated  over  more  units).  Similar  to  a  learning 
slope,  a  95%  rate  slope  will  cause  a  5%  reduction  in  cost,  solely  due  to  rate  effect,  when 
production  rate  doubles.  The  addition  of  the  (^  factor  better  explains  the  variation  in  cost  due  to 
production  rate  changes. 

Terry  continued  to  read;  in  last  year's  annual  estimate  a  95%  rate  slope  was  selected  (and  was 
recommended  for  future  estimates)  after  contractor  data  was  run  through  the  Learn  Program  with 
poor  results.  The  95%  rate  slope  was  chosen  based  on  historical  experience  with  similar  aircraft 
The  documentation  also  stated  that  the  rate  adjustment  is  not  always  appropriate.  Statistical 
analysis  must  be  performed  to  support  any  decision  to  use  or  not  use  a  rate  adjustment  In 
addition  to  this  documentation,  Terry  found  a  checklist  that  demonstrated  how  to  incorporate 
learning  with  rate  (Y=AX^^)  in  an  electronic  spreadsheet  Terry  made  a  copy  of  the  checklist 
for  his  own  use  (atch  6).  Gloria  informed  Terry  that  he  would  not  have  to  perform  this  analysis  on 
all  300  of  the  subcontractors.  Instead,  he  should  only  focus  on  the  four  subcontractors  that  have 
provided  updated  proposals.  The  learning  slopes  for  the  subcontractors  who  submitted  NTEs  are 
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as  follows:  KaspSn  Inc  -  90%;  Bancroft  Corp  -  97%;  DBDCorp-90%;  CGInc-90%. 


Armed  with  the  previous  research  Terry  then  developed  the  following  list  of  specific 
responsibilities. 

1 )  Use  the  Report  42  (atch  7)  to  extract  the  design  and  general  engineering  hours  needed  to 
calculate  the  T1 EAC  for  EMD  sustaining  engineering  labor.  The  hours  will  then  be  spread 
according  to  the  time-phasing  provided  in  attachment  8.  The  base  year  81  EMD  WRAP  rate  will 
be  appli»l  to  the  hours  (atch  9).  Complete  the  analyst  input  sheet  (atch  10)  to  summarize  the 
fiscal  year  costs  and  hours.  OSD  inflation  indices  are  provided  at  attachment  11. 

2)  Use  the  total  EMD  hours  (calculated  from  the  EAC  estimate)  for  the  production  sustaining 
engineering  labor  Tl.  A  learning  slope  of  75.9%  (unit  curve)  for  sustaining  engineering  was 
provided  by  Douglas  Aircraft.  The  base  year  81  production  WRAP  rate  (atch  9)  will  be  applied 
to  these  hours.  Complete  the  analyst  input  sheet  to  summarize  the  fiscal  year  costs  and  hours. 

3 )  Use  the  CES  Tls  and  slopes  to  perform  the  production  sustaining  engiiteering  labor  cross¬ 
check.  Build  a  spreadsheet  to  compare  the  cross-check  to  the  original  estimate. 

4)  Use  the  checklist  at  attachment  6  (or  other  automated  statistical  package)  to  evaluate  the 
contractor  NTEs.  The  evaluation  will  be  based  on  the  resulting  statistics  from  the  statistical 
analysis.  OSD  inflation  rates  are  provided  at  attachment  1 1.  Provide  a  brief  written  summary  of 
the  results  of  this  analysis. 

5 )  Provide  written  documentation  (3-4  pages)  of  the  estimating  process  and  attach  all  supporting 
documentation  (spreadsheets,  analyst  input  sheets,  etc.,). 

6)  Prepare  a  breifing  to  support  the  analysis  and  methodology  (S-10  minutes). 
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C-I7COSTUANCH 
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Atch  2 
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Atch  3 
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Not  To  Exceed  (NTE)  Proposals 
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Note:  Lots  l-lll  are  negotiated  prices.  Contractor  escalation  factors  used. 


Not  To  Exceed  (NTE)  Proposals 
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Note:  Lots  l-lll  are  negotiated  prices.  Contractor  escalatton  factors  used. 


Not  To  Exceed  (NTE)  Proposals 


1,56 
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Note:  Lots  i-lll  are  negotiated  prices.  Contractor  escalation  factors  used. 


Not  To  Exceed  (NTE)  Proposals 
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Note:  Lots  l-lll  are  negotiated  prices.  Contractor  escalation  factors  used. 


RoteADPliCQtton 


This  guidance  can  be  used  to  build  a  spreadsheet  that  will  regress  the  lot 
midpoints  versus  the  cost  with  a  rate  application,  or  without  rate  (in  log 
space). 

Steal: 

Calculate  the  True  Lot  Midpoint  (TLM)  for  each  lot,  using  the 
equation: 


'  ( FirstUnit-.  -  (LastUnit+.  > 

(b +1)*  (FirstUnit -LastUnit-l)  j 

The  b  value  Is  based  on  the  learning  slope  for  each  specific  contractor 
when  calculating  the  TLMP.  Often  midpoints  are  calculated  simply  by 
adding  the  first  and  last  units  together  and  dividing  the  total  by  two  (i.e. 
(first  unit  +  last  unit  )/2).  This  method  is  referred  to  as  the  rule-of-thumb 
method.  Rule-of-thumb  midpoints  may  be  sufficiently  accurate  for  many 
cost  analysis  forecasts,  but  when  a  greater  degree  of  accuracy  is 
required,  true  lot  midpoints  (TLMs)  can  be  used.  True  lot  midpoints  were 
used  in  the  C-17  estimate  due  to  the  high  visibility  of  the  program  and  the 
resulting  need  for  precision. 

2tea2i 

Take  the  Log  of  the  True  Lot  Midpoint  for  each  lot. 

Step  3: 

Extract  the  Then  Year  dollars  (TY$)  for  each  lot  from  the  Not  To 
Exceed  (NTE)  Proposals. 

Step  4; 

Deflate  the  contractor's  TY$  using  OSD  Weighted  Inflation  rates  to 
obtain  an  FY81  Bose  Year  dollar. 

stepA 

Derive  the  Average  Unit  Cost  of  each  lot  (Base  Year$/Lot  Quantity). 

Step..fc 

Calculate  Q'' :  Where  Q  is  the  quantity  of  the  lot,  and  r  is  the  log  of 
the  rate  slope  divided  by  the  log  of  2. 
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StfiGLZl 

To  Incorporate  rate  into  the  regression  analysis,  you  must  first 
normalize  the  unit  cost  by  the  Q*”.  This  can  be  done  with  the  following 
equation. 


UnitCost 

Q 


Normalizing  the  unit  cost  in  this  manner  eliminates  the  potential  for 
multicollinearity  between  the  rate  quantity  (Q)  and  the  lot  quantity  (X)  in 
the  equation  YsAX^^Q*”.  The  normalized  regression  equation  then 
becomes  Y/Q'’  *  AX^. 

Step  8: 

Take  the  log  of  the  and  the  log  of  the  Unit  Cost  (not 

normalized). 

The  next  step  is  to  regress  the  log  unit  costs  (with  and  without  rate) 
against  the  log  of  the  True  Lot  Midpoints  (X).  For  example,  you  will  regress 
Y  versus  X  (without  rate)  and  Y/Q*"  versus  X  (with  rote). 

Step  10: 

Analyze  the  resulting  statistics  and  determine  if  rote  Is  applicable  for 
the  cost  element. 


159 


WBS  DEHNITIONS  AND  ACRONYMS 


Engliweriiig: 

a.  Direct  Lalwr  Hours -The  hours  expended  in  the  study,  analysis,  design,  devdopment. 
evaluatioo.  and  redesign  of  the  qweifiedreportiog  element  Includes  the  prq;nratioo(tf 
spedficarions,  drawings,  parts  lists,  wiring  diagrams,  technical  cooexiination  between  engineering 
and  manufacturing,  vendor  cootdinatioii.  test  planning  and  scheduling,  analysis  of  test  results,  data 
reduction,  and  rqxxt  preparation.  Ihis  also  includes  the  determination  and  specification  of 
requirements  for  rdiability.  maintainability  and  quality  control. 

b.  Direct  Labor  Dollars -The  actual  engineering  direct  labor  dollars  expressed  as  the 
incurred  composite  doflar  rates  per  hour  tinres  the  (firect  labor  hours.  For  projections  the 
composite  dollar  rates  will  be  developed  in  accordance  with  aceqaed  accounting  practices.  Shift 
premiums  and  overtime  prenuums  will  be  riiownimder  other  dir^  charges. 

c.  Overhead -The  proportionate  part  of  indirect  engineering  expenses  properly 
chargeable  for  the  specified  reporting  elemenL 

d.  Material  -  The  cost  of  raw  material,  and  purdused  parts  (e.g.,  printed  circuit  boards) 
evaluated  or  consumed  in  the  performance  of  the  engineering  function  for  the  specified  repotting 
dement  Also  included  is  en^neering  test  equipment  Le.,  oscilloscopes,  transduo*^,  recorders, 
radio  transmitters,  converters,  discriminators,  rivers,  and  similar  equipment  required  to 
accomplish  die  engineering  function  for  the  ^tedfiedrqxxting  element  Included  is  the  ^licable 
costs  of  spedal  test  equipment  as  defined  in  ASPR 15-205, 40(b),  (c)  and  (d). 

e.  Other  Direct  Charges -The  costs  of  travel,  per  diem,  shift  premiums,  overtime 
prerrtiums,  automatic  data  processing,  reproduction  of  printed  material,  and  rental  of  ^lecial  test 
facilities,  and  equipment  and  other  engineering  items  not  allocated  to  the  cat^ories  of  direct  labor, 
overhead  and  material  for  the  specific  rqxxting  dement 

f.  Total -The  sum  of  the  ddlars  for  engineering  direct  labor,  overhead,  material,  and 
other  (Greet  charges  (excliKGng  G&A  and  profit) 

Note:  the  cal^oties(c-e)  are  included  in  die  composite  wrap  rate  given  by  the  appropriate 
analyst 

Sustdning  Engineering  EMD:  Covers  all  of  the  migineering  labor  within  the  DAC  engineering 
functions  of  design  and  general  engineering  for  the  air  vdiicle  (wbs  element  1010)  and  system  test 
and  evaluation  (wbs  dement  1050)  in  the  Cost  Performance  Report  Within  the  function  of  design 
engineering  die  foDowing  effort  is  acconqilished:  structural  and  mechanical  design,  component  test 
tequiremems,  equipment  installation  design,  tedinical  analysis,  preparation  of  procurement 
^edfications,  subcontractor/vendor  liaison  assodated  with  desigit  test  and  fabrication  programs, 
liaison  with  the  customer  and  support  of  manufacturing 

Sustaining  Engineering  -  Production;  Involves  effort  assodated  widi  administration,  change 
evaluation  and  Gaison  widi  the  customer,  venckxs.  manufacturing,  quality  assurance,  product 
support  and  material.  Typically,  sustaining  engineering  also  involves  analysis  and  incorporation  of 
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duuges,  materials  and  process  specificatioa  and  relialnlity  activities.  These  activities  are  not 
e]q)Ucitly  accounted  for  within  the  fonctioo  of  sustaining  engineering  on  this  program.  Within 
WBS  1010,  the  fonctioos  of  Flight  Controls.  Product  Definition.  Product  Ce^  Operations. 
Aircraft  Performance.  Avkmics  Int^ration  and  Int^rated  Logistics  Support  make  up  the 
sustaining  engineering  effort 

LEGEND 

LBR  ASY  HRS  •  AssemUy  Direct  Labor  ifours  (DLH)  for  Manufacturing. 

LBR  FAB  HRS  -  Fabricadon  DLHs  for  Manufacturing. 

LBR  IE  HRS  •  Industrial  Engineering  DLHs  for  Manufacturing. 

LBR  PLG  HRS  •  Planning  DLHs  for  Manufacturing. 

LBR  QA  HRS  -  Quality  Assurance  DLHs  for  Manufacturing 
LBR  TLG  HRS  -  Tooling  DLHs. 

LBR  DES  HRS  -  Design  Engineering  Hours. 

LBR  GEN  HRS  •  General  Engineering  Hours. 

LBR  MC  HRS  •  Nfission  ConqMiier  DLHs. 

LBR  FAC  HRS  -  FaciUdes  DLHs. 

LBRSFCHRS-  Shop  Floor  Control  DLHs. 

LBR  UNA  HRS  -  Unaccounted  for  Actual  DLHs. 

LBR  MIS  HRS-  Management  Informadon  System  DLHs. 

LBRRELHRS-  Materials  Release  DLHs. 

LBRSTRHRS  •  STORES  DLHs. 

BUS  PLNG  -  Business  Planning 
FLT  CTRLS  -  Flight  Cmtttols 
PROD  DEFIN  •  lYoduct  Definidon 
PCO  •  Product  Center  Operations 
FLT  TEST  -  Flight  Test 
A\C  PERFOR  -  Aircraft  Performance 
SUFP  MGMT  -  Siqjplier  Management 
QA  •  Quality  Assurance 
AVION  INTEG  -  Avionics  Int^radon 
ILS  -  Integrated  Logistics  St4>pott 
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TOrAl.l.nRMRS  310  2<M  13710  17  .13<17  433090  434194  330401  090  102287  438326  337391 
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WBSSD  WBS  HOURS  RETORT  BY  SUB  DIVISION 
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SPACE  SYSTEM 
ESTIMATING  USING 
AUTOMATED  COST  ESTIMATING 
INTEGRATED  TOOLS  (ACEIT) 


1-75 


SCENARIO 


Oi  15  June  1993,  the  Assisant  Secretary  of  the  Air  Force,  Financial  Management  and 
Comptroller  (Deputy  for  Cost  Analysis-SAF/FMC)  sent  a  message  to  the  Space  and 
Missile  Systems  Center  (SMC),  at  Los  Angeles  AFB,  California,  establishing  the 
requirement  for  a  Program  Office  Estimate  (POE)  on  the  Space  Based  Wide  Area 
Surveillance  (SBW AS)  system.  SAF/FMC  designated  SMC  as  the  lead  product  center, 
with  assistance  to  come  from  the  Air  Force  Space  Command  in  the  area  of  Operatitms  and 
Support  (O&S),  and  the  Air  Force  Engineering  and  Services  Center  in  the  area  of 
facilities.  The  message  was  then  routed  to  the  SBW  AS  system  program  office.  Since  the 
SB  WAS  system  was  nearing  the  end  of  the  Concept  Exploration  phase  of  the  acquisition 
process,  the  purpose  of  the  POE  was  to  generate  an  estimate  for  the  preferred  SB  WAS 
concept  While  several  alternative  concepts  were  still  being  explored,  the  POE  was  only 
to  address  the  preferred  concept  The  SBWAS  program  office  immediately  called  a  POE 
planning  meeting  to  develop  a  methodology  to  conduct  the  estimating  effort 

Captain  John  Franklin  was  one  of  several  SMC  Staff  cost  analysts  who  attended  the  initial 
POE  plarming  session.  John  worked  in  the  Research  Branch  of  the  Cost  Analysis  Division 
at  SMC  (SMC/FMCR).  John's  duties  in  the  Research  Branch  had  exposed  him  to  a  large 
number  of  cost  models  and  other  estimating  tools  used  both  at  SMC  and  throughout  the 
Air  Force.  But  it  was  his  expertise  with  a  particular  cost  estimating  tool  that  resulted  in 
his  presence  at  that  meeting  in  June.  For  the  last  six  months  John  had  been  working 
extensively  with  a  software  program  developed  by  Tecolote,  Inc.,  called  Automated  Cost 
Estimating  Integrated  Tools  (ACETT).  While  ACETT  had  already  become  a  popular 
estimating  tool  at  the  Electronic  Systems  Center  (ESC),  located  at  Hanscomb  AFB, 
Massachusetts,  Space  and  Missile  Systems  Onter  was  in  the  process  of  explcaing  this 
program's  applicability  to  estimating  in  the  SMC  environment 

John  had  heard  rumors  that  ACETT  might  be  utilized  to  perform  certain  portions  of  the 
POE,  but  he  was  definitely  surprised  when  it  was  announced  at  the  meeting  that  ACETT 
would  be  used  to  conduct  the  entire  estimate.  This  represented  a  major  shift  for  the  SMC 
cost  analysis  staff-a  shift  in  which  John's  experience  with  ACETT  would  be  playing  a 
major  part 


SBWAS  PROGRAM  BACKGROUND 

The  Space  Based  Wide  Area  Surveillance  (SBWAS)  program  responds  to  Wide  Area 
Surveillance  (WAS)  difficulties  identified  by  the  North  American  Aerospace  Defense 
Command  and  the  Unified  and  Specified  Commanders  in  Chief.  This  program  will  provide 
for  the  acquisition  of  a  reliabte,  tdgh  confidence,  all  weather,  day  and  night  all  terrain, 
global,  space  based  system  to  provide  WAS  to  complement  the  current  and  programmed 
surveillance  systems  operated  by  the  warfighting  commands. 
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HISTORY 


The  idea  of  conducting  worldwide  surveillance  via  space  based  sensors  has  existed  and 
matured  over  the  years.  Several  studies  have  explored  the  feasibility  of  such  a  system 
within  the  context  of  current  and  near-term  technology  developmrats.  In  1984  the 
Defense  Science  Board  (DSB)  concluded  that  a  modest  Space  Based  Radar  could  be 
launched  with  existing  technology.  The  DSB  also  recommended  that  current  technology 
development  programs  continue  to  provide  growth  options.  Several  analysis  efforts  were 
subsequently  launched,  resulting  in  definitions  and  successive  refinements  to  a  range  of 
SBWAS  ctmcepts  to  address  existing  operational  requirements. 

In  1991  the  Defense  Review  Board  tasked  tl^  Undersecretary  of  Defense  for  Acquisition 
(USD(A))  to  convene  the  Defense  Acquisition  Board  (DAB)  and  initiate  the  Milestone 
Zero  process  for  an  SBWAS  system.  The  US  Space  Command  prepared  a  Mission  Need 
Statement  (MNS)  and  the  Joint  Requirements  Oversight  Council  subsequently  approved 
the  MNS  prior  to  the  Milestone  Zero  DAB  review.  The  Milestone  Zero  DAB  conveiKd 
on  15  December  1991,  resulting  in  authorization  of  the  SBWAS  program  to  proceed  into 
the  Concept  Exploration  phase.  The  DAB  also  directed  the  Navy  and  Air  Force  to 
conduct  technology  and  ctmcept  defitution  efforts  to  support  a  Milestone  I  decision  in  July 
of  1993. 


As  a  result  of  the  concept  exploration  study  analyses,  the  program  office  selected  the 
center-fed  rotating  reflector  concept  as  the  SBWAS  reference  concept  for  cost  estimating 
purposes. 


SYSTEM  DESCR] 


The  Space  Based  Wide  Area  Surveillance  system  will  (vovide  worldwide  surveillance  from 
space  of  military  systems.  The  intended  targets  include  aircraft,  surface  ships,  and  cruise 
missiles.  The  present  concept  will  provide  real-time  surveillance  of  areas  far  greater  than 
current  recotuudssance  systems.  This  concept  will  allow  for  warning  and  targeting  of 
enemy  weapon  systems  to  the  theater  commander.  The  SBWAS  system  will  also 
extensively  support  strategic  and  tactical  forces  with  timely  threat  data  such  as  threat 
object  heading,  position,  time  of  contact,  potential  identification,  and  an  estimate  of 
information  quality. 

The  SBWAS  system  is  composed  of  five  segments:  a  space  vehicle  segment,  a  space 
coimectivity  segment,  a  ground  segment,  a  user  segment,  and  a  launch  segment 

Space  Vehicle  Segment  The  space  vehicle  segment  will  consist  of  a  system  of  orbiting 
satellites  which  contain  surveillance  sensors  and  necessary  support  systems.  These 
satellites  will  employ  radar  sensors  to  detect  and  track  targets.  The  SBWAS  satellites  will 
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CENTRAL-FED  ROTATING  REFLECTOR  CONCEPT 
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SBWAS  Reference  Concept  -  Rotating  Reflector 


SHARED  RELAY  ,  SDWAS 
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SBWAS  C®  Archiicclufc  -  Low  Altitude 


have,  as  a  minimum,  three  communication  antennas  in  addition  to  any  radar  payload 
antenna.  These  antennas  will  allow  communications  at  three  different  frequencies:  UHF, 
EHF,  andSHF.  The  space  vehicle  consists  of  a  spinning  and  a  despun  section.  The 
spinning  section  contains  the  radar  payload.  The  despun  section  contains  the  power, 
attitude,  control,  communications,  and  propulsion  subsystems.  Figure  1  illustrates  the 
spacecraft  configuration. 

Telemetry,  Tracking  and  Command  (TT&CVCommunications.  The 
TT&C/Communications  is  a  subset  of  the  Space  Vehicle  Segmrat  and  consists  of  four 
elements  which  are  represented  in  both  the  Engineering  and  Manufacturing  Envelopment 
(EMD)  and  Production  Space  Vehicle  Segment  woiic  breakdown  structures  (atch  1). 

1.  Transmitter/ Amplifier  -  This  element  contains  all  the  hardware  associated  with 
the  design,  development,  and  production  of  components  that  transmit  telemetry  and 
tracking  data  to  ground  stations  via  onboard  antennas.  The  amplifier  adds  current  to  the 
signal  thus  making  it  more  powerful  and  easier  to  receive. 

2.  Receiver/Exciter  -  This  element  contains  all  the  hardware  associated  with  the 
design,  development,  and  production  of  components  that  receive  via  a  spacecraft  antenna 
commands  and  tracking  queries  transmitted  from  a  ground  station  or  from  other  satellites. 

3.  Digital  Electronics  -  Contains  all  the  hardware  associated  with  the  design, 
development,  and  production  of  components  that  recognize  the  presence  of  a  signal, 
decrypt  commands,  and  execute  them.  For  telemetry,  this  subsystem  processes  the  output 
data  of  mission  related  equipment  onboard,  performs  an  analog/digital  conversion, 
encrypts  messages,  and  oversees  data  transmission  to  the  ground  station.  Typical 
components/units  include  base  band  units,  general  purpose  computer,  digital  telemetry 
unit,  command  signal  conditioning,  command  distribution  unit,  and  software. 

4.  Analog  Electronics  -  This  element  contains  all  the  hardware  associated  with  the 
design,  development,  and  production  of  those  hardware  components  that  process  analog 
waveforms/signals  at  intermediate/video  frequencies  down  to  direct  current  (EXT).  Typical 
components  include  intermediate  frequency  conditioning  boxes,  interface  electronics, 
control  electronics,  and  analog  drivers. 

Space  Connectivity  Segment.  This  segment  will  consist  of  a  communications  package 
on  three  plaimed  geosynchronous  relay  satellites.  This  package  will  provide  connectivity 
between  the  SBWAS  satellites  and  the  ground  segment  The  relays  must  be  able  to 
communicate  with  as  many  as  three  sensor  satellites  simultaneously.  The  package  will  be 
capable  of  transmitting  and  receiving  EHF  and  S-band,  and  transmitting  UHG  through  an 
omnidirectional  antenna. 

Ground  Segment  The  ground  segment  consists  of  the  Command,  Communication,  and 
Control  (C^)  nodes  which  will  receive  data  for  consumption  or  dissemination.  The 
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planned  architecture  is  shown  in  figure  2.  Mission  data  will  be  downlinked  via  relay 
satellite  to  a  Mission  Operations  Centers  (MOC),  Regional  Space  Support  Centers,  and 
Transportable  Space  Supptwt  Centers-which  are  part  of  the  ground  segment  structure-- 
to  support  each  of  the  Unified  and  Specified  Commanders  in  Chief.  Unlike  the  otl^r 
segments,  the  ground  segment  will  be  procured  with  3080  funds. 

User  Segment  The  SB  WAS  will  provide  survdllance  in  support  of  strategic  and  tactical 
forces.  In  order  to  accomplish  this  task,  SBWAS  terminals  or  other  existing  user 
equipment  may  be  located  on  ships,  submarines,  aircraft,  and  ground  platforms.  Thus  the 
user  segment  consists  of  any  modification  or  other  additions  to  existing  tactical  user  assets 
required  for  dissemination  of  processed  track  data. 

Laundi  Segment.  The  launch  segment  consists  of  the  Atlas  IIAS  launch  vehicle  system 
and  any  launch  operations  required  to  place  a  SBWAS  satellite  into  operational  orbit 


ACQUISITION  APPROACH 

The  SBWAS  Concept  Exploration  was  initiated  in  1991  by  SMC  at  Los  Angeles  AFB, 
California.  The  total  system  acquisition  plan  will  consist  of  the  foUowing  phases: 

DemonstrationA^alidation  (Dem/Val).  Dem/Val  is  a  two  year  program 
beginning  in  1993,  with  full  and  open  competition  for  two  contractors.  The  contractors 
selected  for  the  Dem/Val  effort  are  TRW  and  the  Technical  Science  Corporation  (TSC). 
All  dollars  expended  in  diis  phase  will  come  from  3600  funds.  The  major  emphasis  of 
Dem/Val  will  be  on  ground  demonstrations  of  the  following  key  concept  drivers: 

1.  Antemia  model  full  aperture 

2.  Feed  model  -  brassboard 

3.  Radar  and  data  processing 

4.  Spacecraft  scale  model 

5.  Power  distribution,  voltage,  and  conditioning 

Engineering  and  Manufacturing  Development  (EMD).  EMD  will  be  a  five  ^nd 
one  half  year  program  starting  in  1995.  There  will  be  one  EMD  contractor  who  will  be 
responsible  for  building  two  EMD  satellites  (a  qualification  unit  and  a  prototype  unit). 

The  EMD  units  vidll  be  procured  with  the  3600  appropriation. 

Piroductimi.  The  production  phase  will  be  a  four  year  program  beginning  in  1997. 
The  fiscal  year  buy  schedule  is  provided  below.  The  production  satellites  are  estimated  to 
have  a  seven  year  life.  One  prime  contractor  wiU  serve  as  the  system  integrator  for  the 
entire  SBWAS  system.  There  will  be  subcontractors  for  the  radar  payload,  ground 
segment,  and  user  interface  segment  The  prodiKtion  units  will  be  procured  with  the  3020 
appropriation  (production  schedule  provided  in  the  following  table). 
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FY97 

FY98 

FY99 

FYOO 

TOTAL 

0 

1 

2 

2 

5 

Operations  and  Support  (O&S).  12  O&S  satellites  will  be  produced  to  ensure 
that  the  constellation  of  5  satellites  is  maintained.  The  O&S  phase  will  cover  a  ten  year 
system  steady-state  period,  beginning  in  2001.  The  O&S  producticm  units  will  be 
procured  with  3020  funds.  The  O&S  buy  schedule  is  shown  in  the  following  table. 


FYOl 

FYOl 

FY03 

FY04 

TOTAL 

3 

3 

3 

3 

12 

TASKING 

John  was  appointed  to  the  Space  Vehicle  estimating  team.  The  specific  responsibilities  he 
was  given  were  as  follows: 

1.  Estimate  the  entire  DEM/VAL  phase,  which  includes  technology  costs 
inputs),  contractor  costs  (TRW  inputs),  and  mission  support  (program  office  inputs). 
Provide  abbreviated  documentation  of  the  DemA’^al  estimate. 

2.  Utilize  ACEIT  to  perform  the  following  tasks: 

a.  Estimate  the  non-recurring  EMD  costs  for  the  TT&CVConununications 

subsystems. 

b.  Estimate  the  Production  costs  for  the  TT&C/Communications 

subsystems. 

c.  Perform  sensitivity  analysis  on  the  cost  elements  you  feel  are  the  major 

cost  drivers. 

d.  Provide  full  documentation  of  the  EMD  and  Production  estimates. 

3.  Provide  an  explanation  of  the  application  of  multiplicative  correction  factors 
used  by  ACEIT. 


GROUND  RULES  &ASSI 


Ml  MU 


1.  All  costs  should  be  expressed  in  millions  for  both  then  year  and  base  year  dollars 
(FY91).  OSD  Inflation  rates  are  provided  at  attachment  2. 

2.  Under  the  EMD  and  Production  phases  profit  will  be  12%,  G&A  will  be  20%,  and 
overhead  will  be  105%. 


'y 


3.  The  EMD  costs  are  spread  based  on  the  results  of  an  SMC  Beta  curve  model.  These 
Beta  values  were  selected  as  inputs  for  the  SBWAS  program  since  they  are  based  on 
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actual  contract  history  at  SMC.  From  the  model  the  shape  parameters  are:  %  Spent  =  60; 
%  Hme  =  40;  Peakness  =  .3. 

4.  A  95%  cumulative  average  cost  improvement  curve  should  be  used  to  estimate  the 
(MToduction  recurring  costs.  This  cost  improvement  curve  is  based  on  SMC  experience 
with  past  space  system  contractors. 

5.  There  is  a  lead  time  of  one  year  for  advance  buy  of  the  production  units.  The  advance 
buy  rate  is  10%  of  the  recurring  production  costs  for  the  succeeding  production  buy.  For 
example,  the  FY96  advance  buy  dollars  are  for  the  FY97  production  buy. 


RESEARCH  EFFORT 

Based  on  the  tasking  he  received,  John  decided  to  start  his  estimating  effort  with  the 
DonA^al  portion.  His  boss  had  previously  given  him  the  inputs  from  the  various 
supporting  laboratories  (atch  3).  He  realized  there  were  basically  three  cost  elements  in 
the  DemA^al  estimate;  a  technology  element  based  on  the  supporting  laboratories,  a 
contractor  cost  element  provided  by  TRW,  and  a  Mission  Support  element  provided  by 
the  SB  WAS  program  office.  After  examining  each  of  the  DemA^al  elements,  John  came 
up  with  the  following  descriptions. 

Tedhnology  Element  The  technology  element  contains  support  from  the  following 
laboratories:  the  Massachusetts  Institute  of  Technology/Uncoln  Laboratory  (MIT/LL), 
Rome  Air  Development  Center  (RADC),  the  Air  Force  Geophysics  Laboratory  (AFGL), 
and  the  Air  Force  Astronautics  Laboratory  (AFAL).  MIT/LL  will  be  examining  algorithm 
development  signal  processor  and  transmitter/receiver  (T/R)  module  test  bed 
development  and  near  field  test  methodology.  RADC  will  investigate  high  efficiency-high 
power  S-band  T/R  modules,  development  reflector  feed  analysis,  space  qualified 
components,  and  system  support  AFGL  wiU  be  looking  at  propagation  phenranenology: 
ionospheric  field  measurements,  survey  of  ousting  ionospheric  models,  ionospheric  effects 
analysis,  and  integration  of  results  into  a  SBWAS  simulator.  AFAL  will  be  examining' 
battery  and  power  technology  issues. 

Contractor  Cost  Element  This  element  includes  tasks  to  be  performed  by  two 
contractors:  TRW  and  Technical  Science  Corporation  (TSC).  In  the  Concept  Exploration 
phase  several  reference  concepts  were  developed  for  the  SBWAS  system.  The  rotating 
reflector  concept  developed  by  TRW  was  selected  to  be  the  reference  concept  for  the 
Dem/Val  phase.  Since  TRWs  initial  efforts  utilized  a  rotating  reflector  concept,  their 
estimates  of  Dem/Val  costs  were  used  for  this  estimate.  Specifically,  several  months  ago 
TRW  briefed  their  Dem/Val  estimate  to  the  SBWAS  program  office  (John  was  in 
attendance).  TRW  developed  a  Dem/Val  estimate  of  $59  million  (BY91$)  to  complete 
the  following  tasks  during  the  two  year  DEM/VAL  phase:  1)  key  technology 
dononstrations  including  antenna  feed  tests,  radar  brassboard,  beam  forming  ad2q>tive 
processor  simulation,  reflector  model  demonstration,  feed  thermal  concept  demonstraticm. 
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and  beam  agility  demonstration;  2)  system  definidon  including  system  requirements, 
payload  design,  spacecraft  design,  and  ground  segment  design;  3)  reviews  and  reports. 

The  estimate  was  based  on  one-half  the  work  being  subcontracted.  In  addition,  TRW 
recommended  an  additional  cost  of  5%  be  added  for  Engineering  Change  Orders  (ECO). 
TRW  estimated  a  65-35  percent  phasing  of  contractor  costs  between  fiscal  years  93  and 
94. 

There  is  currently  no  estimate  for  TSCs  DenWal  efforts,  but  it  is  expected  that  their  work 
will  closely  mirror  TRW’s  efiforts. 

Mission  Support  Element  This  element  contains  a  baseline  amount  for  Mission/Other 
Government  Supptxt  in  base  year  dollars.  These  amounts  were  determined  by  estimating 
program  office  manning,  training,  computer  support,  and  travel  expenses.  John  totaled 
these  inputs  and  came  up  with  a  total  mission  support  cost  of  $1  million  per  year  (in  base 
year  91  dollars)  for  the  DemA^al  phase.  John  not^  that  these  costs  will  significantly 
increase  once  the  program  moves  into  the  EMD  phase. 

John  realized  that  the  DEMA^AL  estimate  would  probably  be  the  simplest  task  he  would 
have  to  perform,  so  after  gathering  all  the  necessary  DEMA^AL  data,  he  turned  his 
attention  to  the  EMD  and  Production  estimates.  Knowing  that  ACEFT  would  be  utilized 
to  perform  both  the  EMD  and  Production  estimates,  John  decided  that  he  needed  to 
examine  the  cost  estimating  relationships  (CERs)  within  ACEFT  to  determine  what  his 
data  requirements  would  be. 

After  reviewing  the  ACEFT  CER  library,  John  discovered  that  the  primary  model  used  to 
estimate  the  TT&C/Communications  segment  was  the  "Unmanned  Space  Vehicle  Cost 
Model  (USCM)  Sixth  Edition,"  maintained  at  the  SMC  Cost  Library.  John  had  recently 
received  an  updated  version  of  ACEFT  from  Tecolote,  so  he  felt  confident  that  the  CERs 
were  up  to  date.  However,  John  recalled  that  another  analyst  on  the  SMC  staff  had 
worked  on  a  satellite  system  which  incoiporated  an  EMD  Receiver/Exciter  (R/E) 
TT(^C/Commonications  element  He  dedded  to  give  this  analyst  a  call  and  find  out  if  she 
kn^  of  any  more  recent  data  on  the  R/E  element  The  other  analyst  told  him  that  she  had 
recently  collected  some  new  R/E  data  points  from  various  contractors.  But  she  had  not 
been  able  to  run  any  kind  of  statistical  tests  on  the  data.  Being  familiar  with  ACEFT,  John 
decided  to  use  the  COSTAT  statistical  function  within  ACEFT  to  test  this  new  data  set  for 
possible  use  in  his  EMD  estimate.  The  data  set  is  provided  on  the  following  page.  Below 
is  a  legend  which  defines  the  various  parameters. 

REXWT  -  The  individual  leceiver/exciter  wdght  in  pounds. 

LIFE «  The  space  vehicle  design  life  in  months. 

TOTAL  COST  -  Total  non-recurring  costs  (in  BY91$)  of  the  receiver/exciter  in  millions 
of  dollars. 
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SYSTEM* 

REXWT 

LIFE 

TOTAL  COST($  in  M) 

SX-1 

1.5 

30 

.99 

SX-2 

1.8 

28 

1.2 

SX-3 

54 

78 

2.5 

SX-4 

70 

90 

3.1 

SX-5 

32 

20 

1.5 

SX-6 

54 

78 

2.3 

SX-7 

28 

50 

1.75 

SX-8 

47 

75 

2.6 

SX-9 

40.8 

57 

2.2 

SX-10 

70.1 

100 

3.3 

SX-11 

35.7 

48 

1.9 

SX-12 

12.8 

28 

1.1 

SX-13 

40.5 

65 

2.1 

SX-14 

63 

151 

2.7 

SX-15 

10 

54 

1.4 

’Hliese  systems  are  all  classified  programs  and  thus  their  names  are  concealed. 


In  order  to  use  the  ACEIT  CER  library  John  had  to  input  the  physical/performance 
parameters  of  the  various  TT&CyCommunications  elements.  He  therefore  tasked  the 
SBWAS  engineers  to  provide  these  parameters  for  both  the  EMD  and  Production 
TT&CyCommunications  elements  (atch  4). 

The  next  obstacle  for  John  was  determining  how  to  phase  thi .  osts  of  the  EMD  estimate. 
He  knew  that  SMC  usually  employed  Beta  phasing  as  their  iary  technique.  However, 
John  had  recently  received  a  Rand  study  which  examined  pasv  contractor  engineering 
manhour  efforts  for  electronic  systems.  The  suidy  developed  percentage  spreads  based  on 
engineering  manhours  for  EMD  estimates  from  several  analogous  programs.  Spreads 
were  provided  for  several  space  system  components,  including  separate  spreads  for  both 
digital  electronic  and  analog  electronic  systems.  John  checked  with  the  appropriate 
engineers  and  discovered  that  the  analogous  programs  used  in  the  Rand  study  were  in  fact 
quite  similar  to  the  SBWAS  system,  so  he  made  a  copy  of  the  digital  and  analog  electronic 
spreads  (provided  below). 


YEARl 

YEAR  2 

YEAR3 

YEAR  4 

YEARS 

YEARS 

DIGITAL 

.10 

.30 

.35 

.15 

.08 

.02 

ANALOG 

.20 

.32 

.25 

.17 

.06 

— 

After  conducting  this  research  John  felt  prepared  to  begin  his  estimating  work. 
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Space  Vehidc  Sc^nt  EMD  WBS 


( 


1.1  Space  Vehicle  Segment 

1.1.1  Space  Vehicle  PME/IA&T 

1.1.2  Space  Vehicle  Software  Development 

1.1.3  Space  Vehicle  Radar  Payload 

1.1.4  Space  Vehicle  Platform 

1. 1.4.1  Crosslink  Payload 

1.1.4. 1.1  Crosslink  Transponder 

1.1.4.1.2  Crosslink  Digittd  Electronics 

1.1.4.1.3  Crosslink  Analog  Electronics 

1.1.4.1.4  Crosslink  Antenna 

1. 1.4.2  Spacecraft 

1.1.4.2.1  Spacecraft  Structure 

1 . 1 .4.2.2  Spacecraft  Attitude  Determination 

1.1.4.2.3  Spacecraft  Reaction  Control  System 

1.1. 4.2.4  Spacecraft  Thermal  Control 

1 . 1 .4.2.5  EPS  Power  Generation 

1.1. 4.2.6  EPS  Power  Storage 

1.1. 4.2.7  EPS  Conditioning  Electronics 

1.1.4.2.8  TT&C/Communication  Transmitter/Amplifier 

1.1. 4.2.9  TT&C/Communication  Receiver/Exciter 

1.1.4.2.10  TT&C/Communication  Digital  Electronics 

1 . 1 .4.2. 1 1  TT&C/Communication  Analog  Electronics 

1.1.5  Qualification  Unit  Refurbishment 

1.1.6  Prototype  Unit 

1.1.7  Space  Vehicle  Level  Non-PME  Elements 

1. 1.7.1  Aerospace  Ground  Equipment 

1. 1.7.2  Flight  Support  Operations  and  Services 

1. 1.7.3  Systems  Engineering/Program  Management 

1. 1.7.4  Systems  Test  and  Evaluation 

1. 1.7.5  Data 

1.1.7.6  Fee 


186 


Space  Vchicte  Segment  Production  WBS 


2.1  Space  Vehicle  Segment 

2.1.1  Space  Vehicle  PMEIA&T 

2.1.2  Radar  Payload 

2.1.2.1  Radar  lA&T 

2. 1.2.2  Reflector 

2. 1.2.3  T/R  Modules 

2. 1.2.4  Beam  Steering  Computer 

2.1.2.5  Antenna  Hub 

2. 1.2.6  Transmitter  Beam  Forming  Network 

2. 1.2.7  Receiver  Beam  Forming  Network 

2. 1.2.8  Transmitter  Group 

2. 1.2.8. 1  Transmitter 

2.1.2.8.2  Spoofing  Transmitter 

2. 1.2.9  Receiver 

2.1.2.10  Radar  Electronics 

2.1.2.11  Signal  Processor  Group 

2.1.2.11.1  Front-End  Processor 

2.1.2.11.2  Signal  Processor 

2.1.2.1 1.3  Reaction  Control  System 

2.1.2.11.4  Thermal  Control 

2. 1.2. 1 1.5  EPS  Power  Generation 

2.1.2.11.6  EPS  Power  Storage 

2.1.2.1 1.7  EPS  Power  Distribution 

2. 1 .2. 1 1 .8  EPS  Power  Conditioning  Electronics 

2. 1.2. 1 1.9  TT&OCommunication  Transmitter/Amplifier 

2.1.2.1 1.10  TT&C/Communication  Receiver/Exciter 

2.1.2.11.11  TT&C/Communication  Digital  Electronics 

2. 1.2.1 1.12  TT&C/Communication  Analog  Electronics 

2.1.3  Space  Vehicle  Level  Non-PME  Elements 

2.1.3. 1  Flight  Support  Operations  and  Services 

2. 1.3.2  Systems  Engineering/Progtam  Management 

2. 1.3.3  Systems  Test  and  Evaluation 

2. 1.3.4  Data 

2.1.3.5  Fee 


187 


188 


Atch  2  Page  1  o£  2 


s 

w 


»• 

< 


o 

o 


o 

c» 


H 

X 

M 

« 

S 

II 


c 


M  M  ] 


I  m  ^  4n  «  < 


189 


Atch  2  Page  2  of  2 


I.AB  INPUT 


C 


Fadiity:  MassachusettsInstituteofTechnology  (MTI/LL) 

Fnral  ffninf?  John  Handiick 

Description:  Experimental  investigation  of  ECCM  techniques  and  algorithm 
development,  signal  processor  and  transmitter/receiver  module  test  bed  development,  and 
near  rield  test  methodology. 


Cost  Data;  fS  in  BY911 


FY93  FY94 


Labor  Hours 

164,000 

119,000 

Composite  Labor  Rate  ($/Hour) 

71 

71 

Total  Cost  ($  in  millions) 

11,644.000 

8,449,000 

Note:  The  composite  rate  includes  lUrect  labor,  otter  direct  costs,  and  indirect/ovcrhead  costs. 
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LAB  INPUT 


Facility:  Rome  Air  Development  Center 
Focal  Poiirt;  Janet  Evans 

Description:  Invesdagadon  and  voification  of  high-efficiency-high  power  S-band  T/R 
modules,  development  reflector  feed  analysis,  and  space  qualified  components. 


CostData:f$inBY9n 


FY93  FY94 


Labor  Hours 

33.000 

34.000 

Composite  Labor  Rate  ($/Hour) 

56 

56 

Total  Cost  ($  in  millions) 

1,848.000 

1.904.000 

Note:  The  composite  rate  includes  direct  labor,  and  other  direct  costs.  Indirect/Overhead  costs  are 
not  incladed  in  the  composite  rate  because  this  is  an  Air  Force  Facility. 
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LAB  INPUT 


t 


f 


Fadlity;  Air  Force  Geophysics  Laboratory  (AFGL) 

Fnpal  Point;  Manfred  Kamden 

Description:  Examination  of  propagation  phenomenology  pertaining  to  ionospheric  field 
measurements,  ionoshperic  models,  and  ionospheric  effects  analysis.  Results  will  be 
integrated  into  a  SBWAS  simulator. 


CostData:(SinBY91) 


FY93  FY94 


Labor  Hours 

37,000 

18,000 

Composite  Labor  Rate  ($/Hour) 

53 

53 

Total  Cost  ($  in  millions) 

1,961,000 

954,000 

Note:  The  composite  rate  includes  direct  hbor,  and  otha- direct  costs.  Indirect/Overfaead  costs  arc 
not  included  in  the  composite  rate  because  this  is  an  Air  Force  Facility. 
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LAB  INPUT 


Fadlityr  Air  Force  Astronautics  Laboratory  (AFAL) 

Focal  Point:  Jennifer  Robinson 

Description;  Experimental  investigation  of  battery  and  power  technology. 


Cost  Data;(S  in  BY911 


FY93  FY94 


Labor  Hours 

5,250 

4,100 

Composite  Labor  Rate  ($/Hour) 

54 

54 

Total  Cost  ($  in  millions) 

283,500 

221,400 

Note:  The  ampodte  rate  includes  direct  labor,  and  other  direct  costs.  Indirect/Overhead  costs  are 
not  inditded  in  the  composite  rate  because  this  is  an  Air  Fmxe  Facility. 
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Transmitter/Amplifier  CTJA) 

There  are  three  types  of  T/As  in  the  TT&C/Communications  subsystem:  an  S-band 
transmitter,  a  Beacon  transmitter,  and  a  UHF  transmitter. 

S-Band  Transmitter  Radio  Frequency  Power  Output  (RPOW)  - 19.5  watts 
Beacon  Transmitter  RPOW  - 1.35  watts 
UHF  Transmitter  RPOW  -  22.75  watts 

Telemetry,  Tracking,  and  Command  T/A  Suite  Componenet  Weight  (TTAWT)  -  8.4  lbs 
Communications  T/A  Suite  Component  Weight  (CTAWT)  -  6.32  lbs 

RwtiYcr/ExdtsisIB/E) 

There  are  two  different  types  of  R/Es  in  the  TT&C/Communications  subsystem;  a 
command  receiver  and  a  master  timer. 

Command  R/E  Weight  (REXWT)  -  5.23  lbs 
Master  Timer  R/E  Weight  (REXWT)  -  3.52  lbs 
Space  Vehicle  Design  Life  •  83  months 


There  are  three  different  types  of  digital  electronic  components  in  the 
TT&C/Communications  susbsystem:  a  KG-57  unit,  an  HS-57  unit,  and  a 
Command/Telemetry  unit 

KG-57  DE  Component  Power  Required  (DEPOW)  -  8  watts 

HS-57  DEPOW  -  8  watts 

Conunand/Telemetry  DEPOW  -  48  watts 

KG-57  Communications  DE  Box  Weight  (CDEWT)  -  4.25  lbs 

HS-57  CDEWT- 3.95  lbs 

Command/Telemetry  CDEWT  - 1 1.38  lbs 

For  production,  there  will  be  4  KG-57  units,  2  HS-57  units,  and  1  Command/Telemetry 
unit  in  the  TT&C/Coramunicadons  subsystem. 


Total  Analog  Electronics  Suite  Weight  (AESWT)  -  25.3  lbs  ’ 

Sum  of  Unique  AE  Component  Weights  (UAEWT)  -  14.7  lbs 


$ 
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Other  Performance  Considerations 


In  addition  to  the  above  parameters,  diere  are  ^veral  performance  considerations  which 
y  may  impact  the  overall  cost  of  the  TT&C/Communications  system. 

The  T/A  subsystem  does  not  have  a  TWTA  Technology  Component  (TWT),  and  the  T/A 
component  can  be  categorized  as  a  communications  type  subsystem.  The  R/E  subsystem 
will  operate  in  a  synchronous  orbit  Additionally,  the  mission  of  the  analog  electronics 
subsystem  can  be  categorized  as  a  communications  mission. 
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'2.  Ais~j;r:  ':/.zx:rr.:srr.2ZZvjz:ii,  The  goal  of  this  research  efficrt  was  to  develop  educational 
ceises  that  would  bridge  the  gap  betwew  the  theory  and  principles  of  cost  estimating 
currently  taught  in  the  Air  Force  Institute  of  Technology  (AFIT)  Qraduate  Cost 
Analysis  (GCA)  curriculum  and  the  real  world  of  cost  estimating  in  the  acquisition 
arena.  To  eichieve  these  goals,  the  following  researdi  objectives  were  investigated: 
(1)  Identify  cost  estimating  skills  that  graduates  of  the  AFIT  GCA  curriculum  are 
e:qpected  to  possess.  (2)  Assess  the  relative  importance  of  the  identified  cost 
estimating  skills.  (3)  Select  weapon  system  scenarios  that  are  relevant,  interesting 
and  facilitate  student  performance  of  identified  cost  estimating  skills.  (4)  Provide 
cases  based  on  realistic  scenarios  that  will  facilitate  student  learning  of  important 
cost  estimating  skills.  The  cases  developed  in  this  research  effort  were  inplanented 
in  the  summer  quarter  1993  GCA  seminar  class.  Feedback  from  seminar  students  and 
Air  Force  cost  estimating  organizations  was  collected  to  measure  the  overall 
effectiveness  of  these  cases  in  facilitating  student  learning.  The  results  show 
that  the  cases  developed  in  this  effcxrt  are  effective  in  developing  the  AFIT  GCA 
stix3ents'  abilities  to  apply  cost  estimating  techniques. 


Cases,  Case  Method,  Case  Studies, 

Cost  Estimating  Techniques 

213 

CZ22 

"7.  c:.AS3:7:CAr:c::  S3C"/:;7v  c^ass:.- 

Zr  C?  7>7S 

:cat;cx  siC-siTv  C7ass:?;ca7:cx 

or-  A3S72AC: 

•  2C.  :;:v:;7A7;cx  c?A3S7sac7 

Unclassified 

Unclassified 

UL 

\s\  7;4:-:'-2sc-S5:: 

S‘ 

:enca'C  =c--  2SS  [Rsv  2-BS) 

Pr^scroec  by  A\S;  Stc  Z35**B 
2SS-::2 


f 


AFIT  Control  Number  AFIT/GCA/LAS/93S-5 


AFTT  RESEARCH  ASSESSMENT 


The  purpose  of  this  questionnaire  is  to  determine  the  potential  for  current  and  future  applications 
of  AFTT  thesis  research.  Please  return  completed  questionnaires  to;  DEPARTMENT  OF  THE 
AIR  FORCE,  AIR  FORCE  INSTITUTE  OF  TECHNOLOGY/LAC.  2950  P  STREET.  WRIGHT 
PATTERSON  AFB  OH  45433-7765 

1.  Did  this  research  contribute  to  a  current  research  project? 

a.  Yes  b.  No 

2.  Do  you  believe  this  research  topic  is  significant  enou^  that  it  would  have  been  rcstcarclicd  (or 
contracted)  by  your  organization  or  another  agency  if  AFIT  had  not  researched  it? 

a.  Yes  b.  No 

3.  The  benefits  of  AFIT  research  can  often  be  expressed  by  the  equivalent  value  that  your  agency 
received  by  virtue  of  AFIT  performing  the  research.  Please  estimate  what  this  research  would 
have  cost  in  terms  of  manpower  and/or  doUai^s  if  it  had  been  accomplished  under  contract  or  if  it 
had  been  done  in-house. 

Man  Years _  $ _ 

4.  Often  it  is  not  possible  to  attach  equivalent  dollar  values  to  research,  although  the  results  of 
the  research  may,  in  faa,  be  important  Whether  or  not  you  were  able  to  establish  an  equivalent 
value  for  this  researcli  (3,  above)  what  is  your  estimate  of  its  significance? 

a.  Highly  b.  Significant  c.  Slightly  d.  Of  No 

Significant  Significant  Significance 
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